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ABSTRACT 


Enhanced  solution  techniques  are  developed  for  solving  integer  programs  (IPs)  and 
mixed-integer  programs  (MIPs).  Previously  unsolvable  problems  can  be  solved  with  these 
new  techniques.  We  develop  knapsack  cut-finding  procedures  for  minimal  cover  cuts,  and 
convert  existing  cut-strengthening  theory  into  practical  procedures  that  lift  and  tighten  vio- 
lated minimal  cover  valid  inequalities  to  violated  knapsack  facets  in  polynomial  time.  We 
fmd  a  new  class  of  knapsack  cuts  called  "non-minimal  cover  cuts"  and  a  method  of  lift- 
ing them  called  "deficit  lifting."  Deficit  lifting  enables  all  of  these  cuts  to  be  lifted  and 
tightened  to  facets  as  well.  Extensions  of  these  techniques  enable  us  to  fmd  cuts  for  elas- 
tic knapsack  constraints  and  cuts  for  non-standard  knapsack  constraints.  We  also  develop 
the  new  technique  of  "explicit-constraint  branching"  (ECB).  ECB  enables  the  technique  of 
constraint  branching  to  be  used  on  IPs  and  MIPs  that  do  not  have  the  structure  required  for 
known  "implicit-constraint  branching"  techniques.  When  these  techniques  are  applied  to 
84  randomly  generated  generalized  assignment  problems,  the  combination  of  knapsack  cuts 
and  explicit-constraint  branching  were  able  to  solve  1 00%  of  the  problems  in  under  1 000 
CPU  seconds.  Explicit  constraint  branching  alone  solved  94%,  and  knapsack  cuts  solved 
93%).  Standard  branch  and  bound  alone  solved  only  38%.  The  benefits  of  these  techniques 
are  also  demonstrated  on  some  real-world  generalized  assignment  and  set-partitioning  prob- 
lems. 
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I.         INTRODUCTION 

This  dissertation  develops  new  solution  techniques,  and  improves  existing  solution 
techniques  for  integer  programs  (IPs)  and  mixed-integer  programs  (MIPs).  A  linear  pro- 
gram (LP)  minimizes  or  maximizes  a  linear  objective  function  subject  to  linear  constraints. 
LPs  have  continuous  variables;  restricting  some  of  the  variables  in  an  LP  to  be  integer  re- 
sults in  a  MIP;  restricting  all  variables  to  be  integer  results  in  an  IP  Mixed-integer  and 
integer  programs  are  used  to  model  many  planning  problems  of  the  military  and  industrial 
world  such  as  production  planning,  vehicle  routing  and  scheduling,  fleet  management  and 
weapons  system  procurement. 

In  the  last  few  years,  commercial  solvers  have  dramatically  improved  solution  times 
for  large  LPs,  but  even  modest-sized  IPs  remain  difficult  to  solve.  As  an  example  of  com- 
parable difficulty,  consider  one  of  our  test  problems  (denoted  "DLWRD"  in  Chapter  VI) 
which  is  a  truck-routing  problem  in  the  petroleum  industry:  This  IP  has  only  89  constraints 
and  469  variables  but  cannot  be  solved  in  less  than  1 ,000  seconds  on  a  fast  IBM  workstation 
using  good,  off-the-shelf  technology;  the  corresponding  LP  (formed  by  allowing  the  integer 
variables  of  the  IP  to  admit  continuous  solutions)  can  be  solved  in  a  fraction  of  a  second, 
however.  This  disparity  in  solution  times  indicates  that  additional  research  on  efficiently 
solving  IPs  and  MIPs  is  warranted. 

The  solution  techniques  developed  in  this  dissertation  are  used  to  solve  certain  previ- 
ously unsolved  problems.  We  call  the  combination  of  these  techniques  "composite  enumer- 
ation." Composite  enumeration  combines  constraint-generation  and  constraint-branching 
techniques  within  a  standard  (variable-based)  branch-and-bound  framework.  These  tech- 
niques will  be  described  in  greater  detail  later  in  this  chapter. 

Any  solution  technique  for  MIPs  developed  in  this  dissertation  will  be  valid  for 
(pure)  IPs  as  well.  The  scope  of  applicability  will  be  clearly  stated  for  each  solution  tech- 
nique described.  To  avoid  repeating  "IPs  and  MIPs,"  subsequent  references  to  "MIPs"  will 
mean  "IPs  and  MIPs"  unless  stated  otherwise. 


A.         SOLUTION  TECHNIQUES  FOR  MIPs 

1.  Introduction 

Composite  enumeration  is  the  combination  of  techniques  that  will  be  used  for  solv- 
ing MIPs.  It  works  within  the  framework  of  "branch  and  bound,"  one  of  the  two  standard 
solution  techniques  for  MIPs,  but  it  also  uses  the  other  standard  technique,  "cutting  planes." 
Cutting  planes  are  constraints  that  are  generated  and  then  added  to  the  original  problem 
to  help  solve  it.  Understanding  these  two  basic  techniques  is  essential  to  understanding 
the  fundamentals  of  composite  enumeration,  so  a  brief  introduction  to  these  techniques  is 
given  in  this  section.  Readers  familiar  with  branch  and  bound  and  cutting  planes  may  wish 
to  proceed  directly  to  section  C  where  the  specific  research  areas  of  this  dissertation  are 
discussed. 

To  begin,  we  consider  the  following  IP  (most  of  the  discussion  here  is  valid  for  MIPs 
as  well  as  IPs  but  clarity  is  enhanced  by  considering  pure  IPs  only): 

z*    =    min  ex 

subject  to:  Ax    =    b  (1.1) 

0   <  x    <    u,  x  integer 

where  A  is  an  m  x  n  matrix  and  the  other  vectors  are  commensurately  dimensioned.  The 
optimal  solution  to  (1.1)  is  x*,  and  z*  =  ex*.  Note  that  this  problem  and  its  LP  relaxation 
can  never  be  unbounded  since  all  variables  are  bounded  above  and  below.  Although  we 
show  (1. 1)  with  equality  constraints,  constraints  with  senses  of  <  and  >  are  admitted  in  IPs 
as  well.  If  the  vector  u  is  a  vector  of  all  Is,  then  the  IP  is  a  binary  IP 

Both  standard  branch-and-bound  and  cutting-plane  solution  procedures  begin  by 
solving  the  "LP  relaxation"  of  the  IP  The  LP  relaxation  is  simply  the  IP  with  the  integer 
restriction  on  the  variables  relaxed,  which  allows  the  variables  to  take  on  appropriately 
bounded  continuous  values.  (A  precise  description  appears  in  Chapter  II.)  The  solution 
to  the  LP  relaxation  is  used  as  a  starting  point  for  both  standard  branch-and-bound  and 
cutting-plane  solution  procedures.  If  the  LP  solution  is  integer,  the  IP  has  also  been  solved. 
If  not,  the  LP  solution  still  provides  useful  information.  The  LP's  optimal  objective  function 


Figure  1.  The  convex  hull  of  integer  solutions. 

value  is  a  lower  bound  on  the  IP's  optimal  objective  function  value,  and  it  is  a  reasonable 
assumption  (although  not  always  true)  that  the  integer  optimal  solution  will  be  close  to  the 
LP  solution. 

Before  describing  branch  and  bound,  cutting  planes,  and  an  enhancement  to  standard 
branch  and  bound  called  "constraint  branching,"  a  brief  description  of  the  integer  polytope 
is  included  to  introduce  terminology  and  concepts  referred  to  later  in  this  chapter. 


2.  Description  of  the  Integer  Polytope 

The  feasible  region  of  an  IP  is  a  lattice  of  integer  points.  The  smallest  polytope  that 
encompasses  all  feasible  points  of  the  IP  is  called  "the  convex  hull  of  integer  solutions" 
or,  simply,  "the  convex  hull."  The  convex  hull  is  a  polytope  with  integer  vertices  at  all 
corner  points.  (See  Figure  1 .)  If  the  constraint  set  for  this  polytope  were  known  for  an 
IP,  an  application  of  the  simplex  method  to  the  LP  relaxation  of  the  IP  would  lead  to  an 
optimal  integer  solution  (and  thus  a  solution  to  the  IP),  because  the  simplex  method  proceeds 
from  corner  point  to  corner  point,  and  all  corner  points  of  the  convex  hull  are  integral. 
The  individual  constraints  that  comprise  the  minimal  constraint  set  of  the  convex  hull  are 
referred  to  as  "facets."  The  set  of  facets  for  an  IP  is  unique  (e.g.,  Nemhauser  and  Wolsey, 
1988,  p.  91). 


Figure  2.  An  enumeration  tree. 

3.  Branch  and  Bound 

The  following  explanation  of  enumeration  trees,  branch  and  bound,  and  the  general 
branch-and-bound  algorithm  follows  Garfinkel  and  Nemhauser,  (1972,  pp.  108-118).  The 
explanation  is  in  the  context  of  (1.1),  a  minimization  problem. 

a.  Enumeration  tree 

The  branch-and-bound  process  is  best  described  with  an  enumeration  tree. 
In  an  enumeration  tree,  each  node  Vj  represents  a  problem  to  be  solved  that  relates  back 
to  the  original  problem  vq.  The  feasible  region  of  v3  is  the  feasible  region  of  vo  with  a 
restriction  added  for  each  branch  in  the  path  P3  from  v0  to  v3  Thus,  v3  is  the  same  as  v$ 
with  n  additional  restrictions,  assuming  P3  has  passed  through  n  —  1  nodes  between  (and  not 
including)  t>o  and  v3.  Each  node  has  only  one  immediate  predecessor,  but  may  have  many 
immediate  successors.  For  example,  in  Figure  2,  wi  has  vq  as  its  immediate  predecessor  and 
has  two  immediate  successors.  The  following  description  is  of  LP-based  branch  and  bound 
for  IPs.  but  any  kind  of  useful  relaxation  of  an  IP  may  be  substituted  for  the  LP  relaxation. 

Branch  and  bound  begins  at  vq  by  solving  the  LP  relaxation  of  vo,  LP(0). 
If  the  LP  solution  is  integer,  v0  is  solved.  If  not.  branch  and  bound  recursively  derives  sets 

of  restrictions  from  LP  solutions  that  define  a  set  of  IPs,  v\,  v2 vm  such  that  the  solution 

to  at  least  one  of  these  IPs  solves  t-o,  if  a  solution  exists.  Branch  and  bound  evaluates  the 


corresponding  relaxations  LP(1),  LP(2), ...,  LP(m)  to  obtain  lower  bounds  used  to  prove 
optimality  of  the  solution  obtained,  or  to  prove  that  no  solution  exists. 

The  process  of  "evaluation"  at  v3  determines  if  the  solution  to  Vj  (if  it  exists) 
could  solve  vq.  The  solution  to  LP(j)  determines  whether  or  not  any  subsequent  IPs  can 
be  defined  that  could  lead  to  a  better  solution  than  the  best  integer  solution  found  thus  far, 
called  the  "incumbent."  If  no  such  IPs  can  be  defined,  v  j  is  said  to  be  "fathomed."  If  these 
IPs  can  be  defined,  "branching"  occurs  from  v3. 

Branching  from  v3  defines  new  IPs  that  are  each  a  different  restriction  of  Vj, 
at  least  one  of  which  will  solve  Vj,  if  such  a  solution  exists.  Of  course,  an  optimal  solution 
to  Vj  is  a  feasible  solution  to  v 0.  The  restrictions  that  define  v3l ,  v J2 , . . . ,  Vjk ,  are  derived  from 
the  solution  to  LP(j).  These  nodes  are  the  immediate  successors  of  v3. 

"Node  selection"  at  Vj  determines  the  next  node  to  be  evaluated.  At  Vj,  a 
node  must  be  selected  either  (a)  after  the  immediate  successors  of  v3  are  defined,  or  (b) 
when  Vj  is  fathomed.  If  branching  has  occurred  from  Vj,  one  of  Vj's  immediate  successors 
is  normally  selected.  If  v3  has  been  fathomed,  any  other  node  that  has  not  been  fathomed 
or  branched  from  is  selected.  Such  nodes  are  said  to  be  "live."  Selected  nodes  must  be 
evaluated,  and  the  process  repeats. 

Vj  is  fathomed  when  it  is  determined  that  branching  from  v3  will  not  lead  to 
an  optimal  solution  for  vq  or  no  improvement  on  the  incumbent  can  be  obtained.  The  three 
cases  for  which  v3  is  fathomed  are: 

(1)  LP(j)  is  infeasible.  If  LP  (j)  is  infeasible,  then  v3  is  infeasible. 

(2)  The  solution  to  LP(j)  is  integer.  If  the  solution  of  LP  (j)  is  integer,  then 
any  integer  solution  found  by  further  branching  can  have  no  better  objective  function  value 
than  that  found  at  v3.  (The  incumbent's  objective  function  value,  UBq,  is  an  upper  bound 
on  z*.  Any  subsequent  integer  solution  with  a  lower  objective  function  value  than  UBq 
becomes  the  incumbent,  and  UBq  is  updated.) 

(3)  The  objective  function  value  of  LP  (j)  is  greater  than  or  equal  to  UBq.  If 
the  objective  function  value  of  LP(j)  is  greater  than  or  equal  to  UBq,  any  integer  solution 
found  by  branching  from  v3  would  have  an  objective  function  value  greater  than  (worse 
than)  UBq. 


We  examine  the  branching  process  next.    We  consider  the  problem  (1.1), 
which  is  rewritten  as 

z*  =  min  ex     s.t.  x  €  X, 

where 

X  =  {x|Ax  =  b,  0  <  x  <  u,  x  integer}  . 

If  we  are  attempting  to  find  an  x  €  X  that  minimizes  z*,  vj  restricts  x  to  XjC  X.  The  set 
Xj  is  defined  as 

Xj=  <  x|AJx  =  bJ,  0  <  x  <  u,  x  integer  > 
where  AJx  =  bJ  is  the  original  constraint  set  plus,  usually,  some  additional  constraints. 
When  branching  from  a  node,  the  process  of  "separation"  determines  which  restrictions 
are  applied  to  IP  (J)  to  form  the  IPs  represented  by  the  immediate  successors  of  Vj.  To  view 
how  separation  might  be  achieved  at  Vj,  suppose  information  from  the  solution  to  LP(j) 
suggests  that  x*  «  |_yj  .  We  consider  the  restrictions  0  <  xx  <  [yj  or  |_yj  +  1  <  Xi  < 
Ui,  and  form  a  set  Xj+  consisting  of  two  subsets  of 

Xh     =     |x|AJx  =  bJ,  0  <  x  <  u,  0  <  xt  <  [yj  ,  x  integer! 
=     <  x|AJ1x  =  bjl,  0  <  x  <  u,  x  integer  > 

and 

Xj2    =    jxlA-'x  =  bJ,0  <  x  <  u,  [yj  +  1  <  xt  <  Ui,  x  integer! 

=     <^  x|AJ2x  =  bJ2,  0  <  x  <  u,  x  integer  > 

so  that  Xjj  U  Xj2=  Xj.  In  this  case,  as  for  most  IPs,  XJ+  is  a  partition  of  Xj,  but  a  strict 
partition  is  not  necessary  for  the  branch-and-bound  process  to  converge  (e.g.,  Garfinkel  and 
Nemhauser,  1972,  p.  11 3).  Although  binary  partitioning  has  been  described  here,  partition- 
ing (and  any  other  separation)  can  allow  nodes  to  have  more  than  two  immediate  successors. 
We  have  described  the  foundations  of  branch  and  bound  and  now  provide 
the  details  of  the  complete  branch-and-bound  algorithm.  The  problem  considered  is 

z*  =  min  ex     s.t.  x  G  X.  (1.2) 


Let 

=  x  solves  (1.2) 


f  ex*    ifx* 
\    oo     ifX; 
At  each  node  v3,  the  restricted  problem  is 


ZJ  = 


z*  =  min  ex     s.t.  x  G  Xj.  (1.3) 

A  lower  bound  LB3  <  z*  may  be  calculated  by  considering  some  relaxation  of  (1.3) 

z°  =  min  ex     s.t.  x  G  RjO  Xj  (1.4) 


and  letting 


J  z°  =  cx°    ifxj  =  x  solves  (1.4) 
LBj  "  1         oo  if  R,  =  0. 


An  initial  upper  bound  UBq  can  be  calculated  by  finding  any  x'e  X,  and  letting  UBq  = 
ex'.  Otherwise,  UBq  is  initialized  to  oo.  The  feasible  regions  considered  for  the  LP-based 
branch-and-bound  algorithm  are 

X  =  {x|Ax  =  b,  0  <  x  <  u,  x  integer}  , 

Xj  =  <  x|AJx  =  b3 , 0  <  x  <  u,  x  integer  >  , 

,=  |x|AJx  =  bJ,0  <  x  <  u|  . 


and 


3' 


b.  A  general  branch-and-bound  algorithm 

The  following  algorithm  demonstrates  branch  and  bound  for  an  IP: 
Branch-and-Bound  Algorithm  for  IPs 

•  Input:  An  IP  vq{z*  —  min  ex     s.t.  x  €  Xo)  where 

Xo  =  {x|A  x  =  b°,  0  <  x  <  u,  x  integer}  . 

•  Output:  An  optimal  solution  x*  to  vq,  or  a  message  that  no  solution  exists. 

•  STEP  1:  (Initialization.)  Let  L  =  {v0}  be  the  initial  list  of  live  nodes. 

Let  UBq  =  oo,  LBq  =  — oo,  and  Vj  =  v0,  j  =  0.  Go  to  STEP  2. 

•  STEP  2:  (Evaluation.)  Solve  LP(j).  If  R^  =  0  (i.e.,  LP(j)  is  infeasible),  Vj  is 
fathomed  (case  1)  and  L  =  L  -  {v j},  go  to  STEP  6.  If  LP(j)  has  an  optimal 
solution  xj,  let  LBj  =  z°  and  go  to  STEP  3. 

•  STEP  3:  (Fathoming,  case  2.)  If  xjg  X,  (i.e.,  xj  is  not  integer),  go  to  STEP  4. 
If  x°e  Xj,  let  UBj  =  z°,  vj  is  fathomed  and  L  =  L  -  {vj}.  If  C/Bj  <  UB0,  let 
C/5o  =  ^5j  and  let  x7  =  x°,  where  x7  is  the  incumbent.  Go  to  STEP  6. 

•  STEP  4:  (Fathoming,  case  3.)  If  LBj  >  UBq,  Vj  is  fathomed  and  L  =  L  —  {vj). 
Go  to  STEP  6.  Otherwise,  go  to  STEP  5. 

•  STEP  5:  (Branching.)  Choose  a  separation  (partition)  X3+  that  determines  the 
immediate  successors  of  Vj,  {vji:vj2,  ...,Vjk}.  Update  the  set  of  live  nodes  L  = 

L  ~  ivj}  "*~  {^j'd  uJ2i  •••'  vjk}-  ^°  ^°  STEP  6. 

•  STEP  6:  (Node  selection.)  If  L  =  0,  go  to  STEP  7.  Otherwise,  select  a  live 
node  and  designate  it  Vj.  Go  to  STEP  2. 

•  STEP  7:  (Termination.)  If  [/j?o  =  oo,  print  "The  IP  has  no  feasible  solution." 
If  UBo  <  oo,  the  feasible  solution  that  yielded  UBq  is  optimal,  print  the  optimal 
solution  x*  =  x7. 

c.  An  example  of  branching  on  variables 

The  following  is  an  example  of  branch  and  bound  for  an  IP  where  the  parti- 
tioning is  achieved  by  "branching  on  variables."  This  technique  uses  bounds  on  variables 
to  partition  the  feasible  region  of  the  IP  and  its  LP  relaxation,  and  is  the  most  common 
technique  used  to  solve  IPs.  The  solution  vector  for  LP(j)  is  denoted  x;°  =  [xi,  X2,  X3]. 


Consider  the  following  problem: 

vo:       zq  =    minimize       5xi  +  12x2  +  3x3 

subject  to:     4x1  +    6x2  +    x3    >    17  (1.5) 

x3     e     {0,1,2}, j  =  1,2,3. 

The  LP  relaxation  of  the  problem  is 

LP(0):  zq  =    minimize       5xi  +  12x2  +  3x3 

subject  to:     4xi  +    6x2  +    x3    >     17  (1.6) 

0  <  xj    <    2,j  =  1,2,3. 

The  solution  to  LP(0)  is  xg  =  [2,  l\,  0],  Zq  =LB0  =  28.  Because  x2  is  fractional,  and 
LBq  <  UBq,  a  partition  of  Xo  is  chosen  that  eliminates  the  current  fractional  value  of  x2. 
The  IP  at  each  successor  node  is  vo  restricted  by  either 

x2  <  1  or  x2  >  2. 

Adding  the  restriction  x2  <  1  to  v0  forms  vi,  and  adding  the  restriction  x2  >  2  to  vq  forms 
V2-  Both  nodes  are  live,  and  we  arbitrarily  select  v\  for  evaluation.  Attempting  to  solve  the 
LP  relaxation  of  v\, 

LP(l):  z°  =    minimize       5xx  +  12x2  +  3x3 

subject  to:     4xi  +    6x2  +    x3  >  17  ..  _. 

x2  <  1  {L/) 

0  <  x3  <  2,3  =  1,2,3, 

we  find  the  feasible  region  of  LP  (I)  is  empty  because  forcing  x2  <  1  makes  it  impossible 
to  satisfy  the  first  constraint.  Thus,  v\  is  fathomed  (case  1).  Since  v2  is  still  live,  we  select 
it  for  evaluation  and  solve 

LP(2):  z%  =    minimize       5xi  +  12x2  +  3x3 

subject  to:     4xi  +    6x2  +    x3  >  17  n  Q. 

%2  >  2 

0   <   xj  <  2,  j  =  1,2,3. 

The  solution  to  LP (2)  is  x£  =  [lj,  2,  0],  z°2  =LB2  =  30^.  Because  x1  is  fractional, 
and  LB2  <  UBq,  a  partition  of  X2  is  chosen  to  eliminate  the  current  fractional  value  of  xi . 
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Figure  3.  The  enumeration  tree  for  the  branch-and-bound  example. 

The  IP  at  each  successor  node  is  v2  restricted  by  either 

xi  <  1  or  x\  >  2. 

Adding  the  restriction  x\  <  1  to  v2  forms  vs,  and  adding  the  restriction  x\  >  2  to  v2  forms 
v4.  Both  nodes  are  live,  and  we  arbitrarily  select  v3  for  evaluation.  The  LP  relaxation  is 

LP(3):  z%  —    minimize       5xi  +  12x2  +  3x3 

subject  to:     4xi  4-    6x2  +    X3  >  17 

x2  >  2  (1.9) 

xi  <  1 

0  <  xj  <  2,  j  =  1,2,3. 

ThesolutiontoLP(3)isx^  =  [1,  2,  1],  z%  =  LB3  =  32.  Because  x^  is  integer,  UB3  =  32, 
and  since  UBq  —  min  {00,  32},  UBq  is  set  to  32  and  x;  =  X3,  and  ^3  is  fathomed  (case  2). 
The  remaining  live  node  v\  is  selected  for  evaluation.  The  LP  relaxation  is 

LP(4):  z\  =    minimize       5xj  -f  12x2  +  3x3 

subject  to:     4xj  +    6x2+    X3  >  17 

x2  >  2  (1.10) 

xi  >  2 

0  <   Xj  <  2,  j  =  1,2,3. 

The  solution  to  LP  {A)  is  x°4  =  [2,  2,  0],  z°A  =  LB4  =  34.  Because  x^  is  integer,  UBA  = 
34,  and  UB4  is  compared  with  UBq,  which  is  32.  Since  UB4  >  UBq,  UBq  remains  the 
same.  Because  LB4  >   UBq,  v4  is  fathomed  (case  3).  Since  all  nodes  are  now  fathomed 
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(see  Figure  3),  the  integer  solution  with  the  lowest  objective  function  value  is  the  optimal 
solution  to  vq.  For  this  problem,  the  optimal  solution  was  found  at  v3  with  z*  =  23  =  32 
andx*  =  x7  =  x^  =  [1.  2,  1]. 

When  branch  and  bound  is  used  on  large  problems,  the  usual  goal  is  to  obtain 
an  integer  solution  with  an  objective  function  value  that  is  "close  enough"  to  optimality. 
The  use  of  an  "optimality  tolerance"  precludes  branching  to  find  a  solution  that  could  only 
be  marginally  better  than  the  incumbent,  if  such  a  solution  exists.  The  absolute  optimality 
tolerance  is  a  value  ABSGAP  >  0  specified  by  the  user,  and  a  node  is  fathomed  when  it  is 
guaranteed  that 

UBq  -  LB j  <  ABSGAP  . 

Implementing  this  amended  fathoming  rule  in  the  Branch-and-Bound  Algorithm  for  IPs  is 
accomplished  by  replacing  step  4  with: 

•  STEP  4':  (Fathoming,  case  3.)  Any  node  j  such  that  LB3+  ABSGAP  >  UBq  is 
fathomed,  go  to  STEP  6.  Otherwise,  go  to  STEP  5. 

Solving  an  IP  using  this  fathoming  rule  will  result  in  a  solution  that  is  guaranteed  to  be 
within  ABSGAP  of  the  best  solution  of  the  problem  that  could  theoretically  exist. 

The  relative  optimality  tolerance  is  a  user-specified  percentage  RELGAP 
>  0;  and  a  node  is  fathomed  when  it  is  guaranteed  that 

{UB0-  LBj)/{\LBj\+€)  <  RELGAP/ 100 

where  e  >  0.  Note  that  if  LB3  and  UBq  have  different  signs,  this  procedure  will  not  work. 
Assuming  that  LB3  and  UBq  have  the  same  signs,  this  amended  fathoming  rule  can  be  ac- 
complished by  replacing  step  4  with: 

•  STEP  4":  (Fathoming,  case  3.)  Any  node  j  such  that  (  UBq  -  LB3)/{\LB3\  +  c) 
<  RELGAP  / 100  is  fathomed,  go  to  STEP  6.  Otherwise,  go  to  STEP  5. 

Solving  an  IP  using  this  fathoming  rule  will  result  in  a  solution  that  is  guaranteed  to  be 
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Figure  4.  Adding  a  cutting  plane  to  the  constraint  set  of  an  IP 

within  RELGAP  percent  of  the  best  solution  of  the  problem  that  could  theoretically  exist. 
(A  slight  error  due  to  e  is  possible,  actually.) 

Branch  and  bound  has  been  the  standard  way  to  solve  integer  programs  since 
the  early  1960s,  and  is  credited  to  Land  and  Doig  (1960).  For  simplicity,  this  technique  has 
been  demonstrated  with  an  IP,  but  this  process  is  also  applicable  to  MIPs. 

4.  Cutting  Planes 

This  discussion  focuses  on  IPs  for  simplicity,  but  cutting  planes  are  also  used  with 
MIPs. 

The  cutting-plane  technique,  more  commonly  referred  to  today  as  "constraint  gen- 
eration," generates  additional  constraints  (cuts)  that  are  appended  to  the  constraint  set  of 
the  original  problem.  These  constraints  must  meet  two  criteria:  (a)  They  must  be  "valid  in- 
equalities" that  do  not  eliminate  any  of  the  feasible  solutions  to  the  IP  when  added  to  the 
problem,  and  (b)  they  must  cut  away  the  current  fractional  (IP-infeasible)  solution  to  the 
LP  relaxation.  (See  Figure  4.)  The  goal  of  a  cutting-plane  technique  is  to  iteratively  cut 
away  fractional  solutions  to  the  LP  relaxations  until  the  optimal  solution  to  the  IP  is  found 
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by  solving  the  LP  relaxation. 

Cutting-plane  techniques  fall  into  two  general  categories,  techniques  that  depend 
on  special  structure  in  the  problem  ("structure-dependent  techniques"),  and  techniques  that 
can  be  applied  to  any  IP,  independent  of  the  problem  structure  ("structure-independent  tech- 
niques"). 

Examples  of  structure-dependent  techniques  include  methods  for  generating  valid- 
inequalities  from  the  set  packing  polytope  (Padberg,  1973),  from  the  knapsack  polytope 
(Padberg  1975),  and  from  the  set  covering  polytope  (Cornuejols  and  Sassano,  1989).  Struc- 
ture-dependent techniques  are  relatively  easy  to  implement,  but  usually  cannot  guarantee 
convergence  of  the  cutting-plane  technique  because  they  do  not  derive  cuts  from  the  prob- 
lem's complete  constraint  set.  This  dissertation  uses  cuts  derived  from  the  knapsack  poly- 
tope because  knapsack  constraints  frequently  appear  in  IPs  and  are  fairly  easy  to  find  and 
exploit. 

Structure-independent  cutting-plane  techniques  include  Gomory  cuts  (Gomory, 
1958),  Dantzig  cuts  (Dantzig,  1959)  and  the  Chvatal-Gomory  rounding  method  (Chva- 
tal,1973).  Many  of  these  techniques  have  finite  (convergent)  algorithms  associated  with 
them.  Although  initial  computational  experience  with  structure-independent  techniques 
was  disappointing,  more  recent  research  on  lift-and-project  cuts  (Balas,  Ceria,  and  Cor- 
nuejols, 1993)  and  Chvatal-Gomory  cuts  (Caprara  and  Fischetti,  1996)  has  been  more  suc- 
cessful. Our  initial  experience  with  a  structure-independent  cutting-plane  technique  was 
disappointing,  as  the  computational  overhead  proved  to  be  significant.  Because  of  this,  this 
dissertation  does  not  consider  structure-independent  constraint-generation  techniques  for 
composite  enumeration.  This  is  an  area  for  future  research. 

On  large  problems,  cutting  planes  alone  have  not  usually  been  successful  in  ob- 
taining integer  solutions,  but  the  combination  of  cutting  planes  with  other  techniques  con- 
tinues to  produce  new  solution  methodologies  for  MIPs.  Crowder,  et  al.  (1983)  combine 
preprocessing,  cutting  planes,  and  a  modification  of  branch  and  bound  to  solve  large  binary 
IPs.  Johnson,  et  al.  (1985)  combine  preprocessing,  coefficient  reduction,  cutting  planes  and 
a  modification  of  branch  and  bound  to  solve  large-scale  binary  planning  models. 

Another  combination  of  techniques  called  "branch  and  cut"  adds  cuts  during  the 
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branch-and-bound  process.  It  has  been  used  successfully  to  solve  large  MIPs  with  special 
structure  (Padberg  and  Rinaldi,  1991,  Hoffman  and  Padberg,  1991,  1993,  Balas,  Ceria,  and 
Cornuejols,  1996).  The  cuts  are  generated  from  the  solution  of  an  LP  at  a  node  within  the 
branch-and-bound  enumeration  tree.  These  cuts  can  be  either  "globally  valid"  or  "locally 
valid."  Globally  valid  cuts,  such  as  the  polyhedral  cuts  used  by  Hoffman  and  Padberg 
(1993),  are  cuts  that  are  valid  for  any  node  in  the  enumeration  tree.  Locally  valid  cuts 
are  cuts  generated  from  the  restricted  LP  at  a  particular  node  that  are  only  valid  for  that 
node  and  any  of  its  successors.  Gomory  cuts  and  knapsack  cuts  are  examples  of  cuts  that 
are  locally  valid  when  generated  from  the  restricted  LPs.  The  knapsack  cuts  developed  in 
this  dissertation  could  be  used  in  a  branch-and-cut  framework,  but  we  leave  this  for  future 
research.  We  only  apply  knapsack  cuts  before  the  start  of  branch  and  bound,  where  they  are 
globally  valid. 

Example  1.  This  example  demonstrates  a  simple  cutting-plane  technique  for  MIPs  with 
"knapsack  constraints."  A  pure  IP  is  used  for  illustration  here,  but  the  technique  is  equally 
valid  for  MIPs  containing  binary  knapsack  constraints.  This  technique  is  formalized  in 
Chapter  III,  and  is  the  primary  cutting-plane  technique  used  in  this  dissertation.  The  solution 
vector  for  LP(j)  is  denoted  x°  =  [xi,  £2,  x3,  x4],  and  z°  is  the  objective  function  value 
for  LP (j). 

Consider  the  problem: 

Zq  =    maximize     10xi  +  12x2  +  15x3  +  x4 

subjectto:      3xx  +    4x2+    7x3  +  x4     <     12  (1-11) 

Xj     e     {0,1}  j  =  1,2,3,4. 

This  problem  is  a  binary  "knapsack  problem"  (e.g.,  Garfinkel  and  Nemhauser,  1 972,  pp.  13- 
14).  The  solution  to  the  LP  relaxation  of  (1. 11)  is  xi  =  1,  x2  =  1,  x3  =  |,  x4  =  0, 
zq  =  32|.  By  considering  the  knapsack  constraint 

3xT  +  4x2  +  7x3  +  x4  <  12,  (1-12) 

and  the  LP  solution  of  (1. 11),  it  is  clear  that  the  three  variables  that  were  positive  in  the 
solution  to  the  LP  relaxation  cannot  all  be  set  to  1,  since  this  would  violate  (1.12).    An 
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inequality  that  expresses  this  statement  is 

x1  +  x2  +  x3<2.  (1.13) 

Because  this  inequality  does  not  eliminate  any  valid  solutions  to  (1. 11),  it  is  a  "valid  in- 
equality" for  the  IR  Because 

Xi  +  x2  +  x3   >  2, 
the  valid  inequality  (1. 1 3)  is  violated  by  the  fractional  solution  to  the  LP  relaxation,  so  (1. 1 3) 
is  also  a  "cut."  By  appending  (1.13)  to  (1. 11),  a  new  IP  is  formed: 

z\  —    maximize     10xi  4-  12x2  +  15x3  -I-  x4 

subject  to:      3xx  +    4x2+    7x3  +  x4  <  12 

Xj  +      x2+      x3  <  2  (        > 

xj  e  {0:1}  j  =  1,2,3,4. 

The  solution  to  the  first  LP  relaxation,  x i  =  1.  X2  =  1,  X3  =  |.  x4  =  0,  has  been  cut  off  by 
the  cutting  plane  x\  +  x2  +  X3  <  2,  and  is  now  infeasible  to  the  LP  relaxation  of  (1.14).  The 
solution  to  the  LP  relaxation  of(1. 14)  is  an  integer  solution  ?!  =  0,  x2  =  1,  x 3  =  1,  x 4  =  1, 
z°  =  z\  =  28,  and  the  problem  is  solved. 
End  example  1. 

5.  Constraint  Branching 

Since  its  inception,  there  has  been  a  quest  to  improve  the  process  of  branch  and 
bound.  Branch-and-cut  techniques  seek  to  improve  the  process  by  using  cutting  planes. 
Constraint  branching  takes  a  different  approach.  First,  consider  variable-based  branch  and 
bound  for  MIPs.  It  partitions  the  feasible  region  of  the  MIP  by  branching  on  single  integer 
variables.  For  instance,  if 

k  <  Xj  <  k  +  1 
for  some  integer  k .  the  branching  choices  are 

Xj  <  k  or  Xj  >  k  +  1. 
This  often  creates  an  unbalanced  enumeration  tree,  especially  in  the  case  of  binary  variables. 
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(We  explain  the  concept  of  "balance"  in  the  next  section.)  If  we  could  discover  a  bounded 
relationship  involving  a  set  of  variables,  such  as 

k  <  \     cijXj  <  k  +  1, 
j 

where  all  a3  as  well  as  k  are  integer,  we  could  partition  the  IP's  feasible  region  with  re- 
spect to  the  entire  expression  ^  a3x3.   This  technique  has  the  potential  to  create  a  bet- 

3 

ter  balanced  enumeration  tree.  The  choice  for  "constraint  branching"  might  consider  the 
branching  choices 

>     a3x3  <  k  or    >     djXj  >  k  +  1. 

j  J 

Certain  applications  of  this  technique  have  proven  to  be  much  more  effective  than  variable- 
based  branch  and  bound  for  problems  with  special  structure. 

Beale  and  Tomlin  (1973)  developed  the  first  application  of  constraint  branching 
using  "special  ordered  sets."  Special  ordered  sets  (SOS)  are  sets  of  variables  within  ex- 
isting constraints  that  share  a  common  property.  For  example,  the  set  of  variables  in  a 
set-partitioning  constraint  (^  x3 ■,  =  1,  x3  binary  for  all  j  G  J7)  share  the  Type  1  SOS 
property  that  at  most  one  of  the  variables  in  the  set  can  be  non-zero.  Partitioning  with  SOS 
is  achieved  using  the  solution  values  from  the  LP  relaxation  and  the  user-implied  ordering 
of  the  variables.  This  information  is  used  to  define  subsets  of  the  variables  that  determine 
the  restrictions  for  each  new  IP  formed.  The  actual  restriction  is  accomplished  logically, 
without  adding  any  new  constraints  to  the  MIPs  formed  at  the  subsequent  nodes.  SOS  is 
discussed  in  more  detail  in  the  next  section. 

The  "implicit-constraint-branching"  approach  of  SOS  is  an  efficient  technique,  since 
explicitly  adding  constraints  and/or  variables  to  a  problem  can  make  the  problem  more  com- 
putationally difficult.  Although  Beale  and  Tomlin  recognized  two  special  ordered  sets,  most 
MIP  solution  software  packages  today  also  include  a  third  type  of  special  ordered  set  (e.g., 
CPLEX,  1993,  pp.71 -73).  Foster  and  Ryan  (1981)  recognize  a  relationship  between  sets 
of  variables  in  overlapping  set-partitioning  constraints  and  develop  an  implicit-constraint- 
branching  technique  for  problems  with  this  property. 

One  limitation  of  implicit-constraint  branching  is  that  it  can  only  be  used  when 
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special  structure  exists  somewhere  in  a  MIP  Adding  additional  structure  to  a  MIP  allows 
another  type  of  constraint  branching  called  "explicit-constraint  branching"  (suggested  by 
Wood,  1 994)  that  has  proven  useful  for  certain  classes  of  problems.  This  technique  adds 
structure,  constraints  and  variables,  to  facilitate  the  branch-and-bound  process.  Our  results 
in  Chapter  VI  show  that  the  increased  difficulty  resulting  from  the  added  structure  is  often 
outweighed  by  a  reduction  in  the  size  of  the  enumeration  tree.  This  technique  is  outlined  in 
section  C.3. 

a.  Implicit-constraint  branching 

To  illustrate  why  constraint  branching  might  be  preferred  to  variable  branch- 
ing, we  discuss  an  example  of  implicit-constraint  branching  with  SOS  variables. 
Assume  a  MIP,  vo,  has  q  "set-partitioning  constraints'"  of  the  form 

J2  xj  = L 

where  the  x3  are  binary  variables,  J  is  the  set  of  all  variables  in  the  problem,  J;  c  J, 
and  i  =  1,  ...,q.  We  are  at  v0  of  the  branch-and-bound  tree,  and  have  solved  the  LP  relax- 
ation of  v0,  LP(0).  Each  set  of  variables  Xj,  j  E  Ji,  i  =  1,  ...,q  is  an  example  of  an  SOS 
of  "Type  1,"  which  is  a  set  of  variables  of  which  at  most  one  variable  may  be  non-zero 
(e.g.,CPLEX,  1993,  p. 72).  We  first  examine  the  values  of  the  variables  in  the  solution  to 
LP(0).  If  all  integer  variables  have  integer  values,  v0  is  solved.  Suppose  not,  and  suppose 
that  set-partitioning  constraint  p  has  "fractional  variables,"  i.e.,  variables  with  fractional 
LP  solution  values.  The  set  of  variables  Jp  in  the  constraint  is  then  partitioned  into  two 
disjoint  subsets,  j£  and  «/£"*" \each  containing  one  or  more  fractional  variables.  (The  user- 
specified  ordering  of  the  variables  also  influences  the  composition  of  the  subsets.)  v0  will 
be  restricted  by  either 

]T    Xj ;  =  1  or   Y2  xj  =  L 
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Figure  5.  Implicit-constraint  branching.  Partitioning  at  V2  is  achieved  by  forming  two  disjoint  subsets  J^  and  J*  such 
that  Jp1  =  Jp3  U  .7P4. 

Those  restrictions  are  equivalent  to 

^Xj<0or     Y^    xj<®-  (1-15) 


izJP  jei. 
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Instead  of  adding  the  appropriate  constraint  to  vq,  implicit-constraint  branching  is  carried 
out  logically.  If  from  vq  we  select  v±,  the  first  restriction  in  (1.15)  is  implicitly  added  to  vq 
by  setting  Xj  =  0  for  all  j  e  j£.  If  we  select  v2,  the  second  restriction  in  (1.15)  is  implicitly 
added  to  vq  by  setting  Xj  =  0  for  all  j  €  Jp+l-  Because  no  constraints  are  actually  added 
to  the  problem,  this  is  an  implicit-constraint-branching  technique.  (See  Figure  5.) 

Intuitively,  this  constraint-branching  procedure  is  preferred  to  variable-based  branch 
and  bound  because  it  eliminates  the  unbalanced  decisions  that  are  made  by  branching  on 
single  binary  variables.  The  variable-based  branch-and-bound  algorithm  must  choose  a 
variable  to  branch  on.  Setting  the  variable  to  0  is  a  weak  decision,  since  all  the  variables  in 
a  set-partitioning  constraint  except  one  are  set  to  0  in  the  final  solution  anyway.  Setting  a 
variable  to  1  is  a  strong  decision,  because  it  forces  all  other  variables  in  the  constraint  to  be 
set  to  0. 

The  SOS  technique  makes  a  choice  that  moderates  the  "strength"  of  the 
decision  made.  Branching  to  a  subsequent  node  restricts  all  the  variables  in  one  subset  to  0, 
and  allows  any  combination  of  the  variables  in  the  other  subset  to  sum  to  1 .  As  the  branching 
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progresses,  the  "strong"  decision  of  setting  a  particular  variable  to  one  is  delayed,  while 
unpromising  variables  are  culled  out  of  the  unrestricted  "sum  to  1 "  subset  and  placed  in  the 
new  "set  to  0"  subset.  Once  an  integer  solution  is  found,  other  partitions  are  explored  using 
different  subsets,  and  the  process  progresses  in  the  same  manner.  Favorable  computational 
results  using  SOS  are  reported  by  Crowder,  et  al.  (1983)  and  Hummeltenberg  (1984). 

We  call  any  enumeration  technique  for  IPs  that  partitions  the  feasible  region 
sufficiently  to  guarantee  convergence  a  "complete"  enumeration  technique.  SOS  Type  1  is 
an  example  of  a  complete  enumeration  technique  when  all  variables  fall  into  at  least  one 
set-partitioning  constraint.  Enumeration  techniques  that  cannot  guarantee  convergence  are 
called  "incomplete."  Our  basic  explicit-constraint-branching  technique  (outlined  in  section 
C.  3)  is  an  example  of  an  incomplete  enumeration  technique:  It  must  revert  to  variable-based 
branch  and  bound  on  the  problem's  original  variables  to  guarantee  convergence. 

b.  Generalized  branching 

"Generalized  branching"  is  a  relatively  new  term.  In  a  generic  context,  it 
refers  to  all  branching  techniques  other  than  standard  variable-based  branch  and  bound. 
Techniques  such  as  implicit-constraint  branching,  our  explicit-constraint  branching,  and 
some  branch-and-price  techniques  (e.g.,  Sol,  1994)  are  generalized  branching  techniques. 
Jornsten  and  Larsson  (1988)  develop  a  technique  they  call  "generalized  branching"  which, 
as  described  in  Jornsten  and  Varbrand  (1991),  adds  branching  constraints  at  nodes  of  the 
branch  and  bound  process. 

B.         ORGANIZATION 

This  dissertation  is  organized  as  follows: 

•  The  remaining  sections  of  this  chapter  summarize  the  key  results  developed  in 
this  dissertation.  These  results  include  computationally  efficient  procedures  for 
deriving  a  violated  knapsack  facet  from  an  individual  knapsack  constraint,  a  new 
class  of  knapsack  cuts,  and  a  new  branching  technique  called  "explicit-constraint 
branching"  that  improves  branch-and-bound  performance. 

•  Chapter  II  provides  definitions  and  other  preliminary  material. 
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•  Chapter  III  develops  two  cut-generation  techniques  for  standard  knapsack  con- 
straints, lifting  and  tigrr  ing  techniques  that  guarantee  the  creation  of  stronger 
cuts  from  those  original^  generated,  and  a  new  class  of  knapsack  cuts. 

•  Chapter  IV  develops  a  cut-generation  technique  for  elastic  knapsack  constraints 
and  transformations  that  allow  cut  generation  for  non-standard  knapsack  con- 
straints. 

•  Chapter  V  develops  the  technique  of  explicit-constraint  branching. 

•  Chapter  VI  outlines  results  of  composite  enumeration  as  applied  to  a  series  of  test 
problems  including  modified  and  standard  Generalized  Assignment  Problems 
(GAPs). 

•  Chapter  VII  summarizes  completed  research. 

C.         ENHANCED  SOLUTION  TECHNIQUES  FOR  MIPs 

1.  Introduction 

We  will  show  that  combining  cutting  planes  derived  from  individual  knapsack  con- 
straints with  an  explicit-constraint  branching  technique  (discussed  in  section  C.3)  produces 
remarkable  computational  results.  While  knapsack  cuts  alone  rarely  solve  previously  un- 
solvable  MIPs,  our  research  shows  that  the  combination  of  knapsack  cuts  with  explicit- 
constraint  branching  solves  MIPs  that  cannot  be  solved  in  a  practical  amount  of  computing 
time  by  either  of  the  two  techniques  applied  in  isolation.  The  use  of  knapsack  cuts  makes 
intuitive  sense,  and  they  are  easy  to  exploit.  The  knapsack  structure  is  commonly  found  in 
many  real-world  problems. 

2.  Cutting  Planes  from  the  0-1  Knapsack  Polytope 

a.  Knapsack  facets 

A  constraint  of  the  form 

y  djXj  <  b, 
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where  a.j  and  b  are  positive  integers,  Xj  are  binary  variables,  and  Jx  C  J  is  commonly  re- 
ferred to  as  a  "knapsack  constraint."  Knapsack  constraints  are  often  used  to  model  con- 
sumption of  limited  resources,  where  b  represents  the  amount  of  resource  available  and 
a,j  represents  the  amount  of  resource  that  will  be  consumed  if  the  variable  representing  a 
resource-consuming  process  Xj  is  activated  by  setting  x3 ■  =  1 . 

One  of  the  key  results  of  this  dissertation  is  a  cutting-plane  technique  for  a 
knapsack  constraint  that  finds  a  maximally  violated  "minimal  cover  cut,"  (e.g.,  Balas  and 
Zemel,  1978)  if  one  exists,  and  then  lifts  and  tightens  the  cut  to  a  facet  of  the  knapsack 
polytope,  all  in  pseudo-polynomial  time.  We  first  require  a  feasible  solution  to  the  LP 
relaxation  of  the  MIP  To  be  a  candidate  for  a  cutting-plane  technique,  a  knapsack  constraint 
must  have  at  least  one  variable  with  a  fractional  LP  solution  value.  For  these  candidates,  we 
find  a  maximally  violated  minimal  cover  cut,  if  one  exists,  in  pseudo-polynomial  time  by 
using  dynamic  programming;  this  requires  that  the  coefficients  and  the  right-hand  side  of  the 
knapsack  constraint  be  integer.  Then,  a  procedure  that  combines  "lifting"  and  "tightening" 
creates  a  facet  from  the  minimal  cover  cut  in  polynomial  time.  The  combination  of  the  two 
procedures  is  a  technique  that  finds  a  maximally  violated  facet  of  the  knapsack  polytope 
in  pseudo-polynomial  time.  A  new  cut-finding  procedure  for  a  knapsack  constraint  finds  a 
"non-minimal  cover  cut"  if  one  exists  but  no  minimal  cover  cut  does.  A  similar  lifting  and 
tightening  procedure  creates  a  knapsack  facet  from  this  cut  as  well.  Results  are  extended 
to  elastic  knapsack  constraints  and  knapsack  constraints  with  greater-than-or  equal-to  and 
equality  senses.  (Chapter  II  provides  the  definitions  of  "lifting,"  "tightening,"  "minimal 
cover"  and  "minimal  cover  cut.") 

As  with  most  cutting-plane  techniques  that  rely  on  limited  special  structure, 
these  techniques  are  not  convergent.  That  is,  they  will  not  generate  cuts  that  define  the 
convex  hull  of  the  MIP  in  enough  detail  to  solve  the  MIP  This  is  true  because  knapsack 
facets  are  derived  from  individual  knapsack  constraints,  and  thus  are  facets  of  the  knapsack 
polytope,  but  are  not  usually  facets  of  the  MIP's  polytope.  Nonetheless,  these  knapsack  cuts 
enable  other  branching  techniques  to  work  more  quickly  and  efficiently.  Knapsack  cuts  are 
derived  in  Chapter  III. 

The  properties  of  the  knapsack  polytope  have  been  explored  in  the  literature 
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for  over  20  years.  Our  research  builds  on  results  found  in  the  seminal  papers  of  Padberg, 
Balas,  and  Zemel.  Padberg's  method  for  lifting  a  minimal  cover  valid  inequality  to  a  facet 
(1975)  is  a  key  result  that  has  laid  the  groundwork  for  many  other  knapsack  results.  From 
Padberg's  result,  Balas  (1975)  develops  necessary  and  sufficient  conditions  for  classes  of 
inequalities  to  define  facets  of  the  knapsack  polytope.  Balas  and  Zemel  identify  the  class 
of  all  facets  associated  with  minimal  covers  for  a  knapsack  polytope  (1978).  Padberg's 
knapsack  result  is  applied  to  help  solve  large-scale  binary  IPs  by  Crowder,  Johnson,  and 
Padberg  (1 983).  Zemel  (1989)  develops  a  method  to  lift  a  minimal  cover  valid  inequality  to 
a  facet  in  polynomial  time.  Research  continues  today  with  Boyd's  recent  papers  on  Fenchel 
cutting  planes,  which  are  cuts  for  the  knapsack  polyhedron  (Boyd,  1992,  1994). 

b.  Computational  complexity 

Any  cutting-plane  technique  developed  for  use  on  practical  problems  must 
be  computationally  tractable.  Computational  experience  has  shown  knapsack  cuts  to  be 
useful  for  reducing  variable-based  branch  and  bound  enumeration  (Crowder  et  al.,  1983), 
but  the  additional  constraints  generated  must  be  more  useful  than  the  computational  over- 
head added  by  the  actual  process  of  generating  the  cuts.  The  emphasis  on  computational 
complexity  is  demonstrated  by  the  following  excerpt  from  a  paper  on  knapsack  cuts: 

...it  is  not  clear  that  given  a  minimal  cover  from  which  a  violated  facet  can  be 
generated  by  lifting  and  complementing  that  such  a  facet  can  be  generated 
in  pseudo-polynomial  time  (the  polynomial  time  lifting  theorem  of  Zemel 
guarantees  a  facet,  not  a  violated  facet).  (Boyd,  1992) 

The  lifting  and  tightening  methodology  we  develop  for  minimal  cover  cuts 
lifts  and  tightens  a  minimal  cover  cut  to  a  violated  facet  in  polynomial  time. 

c.  Cuts  for  elastic  knapsack  constraints 

An  elastic  constraint  is  a  constraint  from  a  MIP  that  has  been  transformed  by 
the  addition  of  one  or  more  variables  that  allow  penalized  violation  of  the  constraint.  The 
penalty  is  applied  by  adding  each  elastic  variable  to  the  objective  function  with  some  coef- 
ficient p  that  represents  the  cost  per  unit  of  violation.  Elastic  constraints  occur  frequently 
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in  LPs  and  MIPs  (e.g.,  Brown  and  Graves,  1981).  While  any  constraint  can  be  made  elas- 
tic, knapsack  constraints  are  prime  candidates  for  "elasticizing."  Consider  the  knapsack 
constraint 

7J  ajxj  <  b-  (1-16) 

j€Ji 

We  create  an  elastic  knapsack  constraint  from  (1.16)  by  adding  an  elastic  variable  z  >  0  : 

y     djXj  —  z  <  b. 

The  variable  z  represents  the  additional  units  of  resource  that  can  be  used  above  and  beyond 
the  basic  limit  of  b  if  an  appropriate  (linear)  penalty  is  paid.  The  variable  z  may  or  may  not 
be  explicitly  bounded. 

Our  research  extends  the  basic  knapsack  cut  results  to  derive  cuts  from  elas- 
tic knapsack  constraints.  This  new  result  (Chapter  III)  allows  the  use  of  knapsack  cutting 
planes  on  the  Generalized  Generalized  Assignment  Problem  (GGAP),  an  extension  of  the 
GAP  that  uses  elastic  knapsack  constraints.  The  GGAP  is  described  in  Chapter  II. 

3.  Explicit-Constraint  Branching 

"Explicit-constraint  branching"  (ECB)  is  a  new  technique  that  allows  the  benefits  of 
constraint  branching  for  problems  lacking  the  special  structure  required  of  known  implicit- 
constraint-branching  techniques.  This  new  technique  is  remarkable  because  the  combina- 
tion of  variable-based  branch  and  bound  and  ECB  solves  MIPs  that  variable-based  branch 
and  bound  alone  cannot  solve.  When  knapsack  cuts  are  added  to  this  combination,  the  per- 
formance is  often  better  yet. 

The  constraints  and  general  integer  variables  that  ECB  adds  to  a  MIP  facilitate 
variable-based  branch  and  bound.  This  may  sound  counterintuitive,  but  a  simple  exam- 
ple illustrates  why  this  technique  has  merit. 

Example  2.  Consider  the  binary  IP  (the  problem  is  trivial,  but  serves  to  highlight  the  ben- 
efits of  ECB  on  even  small  problems) 
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maximize       ]T  xj 

U\ 


2 


+  1 


subject  to:     ^  2x3     <    2 

x3    e    {0,1}  VjeJ. 


\J\ 

2 


of  the  variables  equal  to  1, 


The  LP  relaxation  has  an  extreme  point  solution  with 
variable  equal  to  .5,  and  the  other  \J\—  y  -  1  variables  equal  to  0.  Variable-based  branch 
and  bound  forms  a  partition  based  on  the  one  fractional  variable,  which  we  designate  as  Xf, 
and  derives  the  restrictions 

Xf  <  0  or  xj  >  1. 
Each  subsequent  LP  relaxation  solved  at  a  node  of  the  enumeration  tree  has  one  of  the  re- 
maining unfixed  variables  fractional,  until  the  last  variable  is  fixed  by  branch  and  bound, 
and  an  integer  solution  is  finally  obtained.  Although  this  integer  solution  is  an  optimal  so- 
lution, the  bounding  information  is  not  sufficient  to  fathom  other  live  nodes,  so  another  live 
node  is  selected,  and  after  a  similar  lengthy  path  around  the  enumeration  tree  fixing  frac- 
tional variables  at  each  node,  another  (alternate)  optimal  solution  is  found.  This  exhaustive 

process  continues  until  all  ( ,  jj  , )  alternate  optimal  solutions  are  enumerated. 

L  2  J 

We  employ  constraint  branching  on  this  problem  to  reduce  the  number  of  nodes 
branch  and  bound  must  enumerate.  By  adding  an  additional  variable  y,  called  a  "branching 
variable,"  and  a  constraint  (redundant  to  the  IP)  of  the  form 

y^  Xj ;  -  y  =  0, 
we  form  the  modified  problem 


maximize       ^  x3 

subject  to:     ]T  2xj  <    2 

J2  Xj     -y    =    0 
jeJ 


\J\ 

2 


+  1 


e    {0,1}  Vjg  J 

y     e     {0,1,2,. ..,|J|}. 
The  LP  relaxation  solves  exactly  as  before  for  the  x3,  and  the  branching  variable  y  is  equal  to 
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2 


+  .5.  The  variable-based  branch  and  bound  partition  based  on  y  derives  the  restrictions 


y< 


\J\ 


oiy  > 


\J\ 


+  1. 


The  second  restriction  is  infeasible,  and  the  first  yields  an  LP  relaxation  with  optimal  ex- 
treme points.  Variable-based  branch  and  bound,  using  the  simplex  algorithm  to  solve  the 
LP  relaxations,  requires  only  three  nodes  to  solve  this  problem. 
End  Example  2. 

In  general,  the  application  of  explicit-constraint  branching  adds  a  constraint 

^  Xj -  y  =  0 

j€J' 

where  f  C  J,  and  J  is  the  set  of  indices  of  all  integer  variables  of  the  problem.  ECB 
constraints  can  be  added  for  any  set  of  integer  variables  of  a  MIP,  but  the  sets  of  variables 
used  to  form  ECB  constraints  must  be  intelligently  chosen  if  computational  improvements 
are  to  be  realized.  ECB  constraints  are  discussed  in  Chapter  V. 

The  next  chapter  defines  the  key  terms  and  introduces  the  notation  that  will  be  used 
throughout  the  rest  of  the  dissertation. 
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II.        PRELIMINARIES 

This  chapter  defines  key  terms  used  in  subsequent  chapters.  This  chapter  also  gives 
formulations  for  the  IPs  that  are  used  for  computational  testing  of  the  solution  techniques 
developed  in  the  dissertation. 

A.         DEFINITIONS 

1.  General 

The  notation  in  this  section  follows  Balas  and  Zemel  (1 978).  Most  of  the  definitions 
are  standard,  but  a  good  reference  for  them  is  Nemhauser  and  Wolsey  (1988). 

•  The  knapsack  problem  is  a  binary  integer  program  that  maximizes  the  sum  of  the 
utility  of  the  items  that  can  be  carried  in  a  knapsack  with  limited  carrying  capacity. 
For  the  purpose  of  illustration,  it  is  assumed  that  there  is  a  single  constraint  on 
the  total  weight  that  the  knapsack  can  carry.  The  problem  can  be  formulated  as: 

Indices: 

j  6  N     items  that  can  be  placed  in  the  in  the  knapsack. 

Given  data: 
Cj    utility  of  item  j :. 
a,j    weight  of  item  j ;. 
b     total  weight  the  knapsack  can  carry. 

Decision  variables: 

Xj     1  if  item  j  is  placed  in  the  knapsack;  0  otherwise. 

Formulation: 

maximize      ^  CjXj 

subject  to:     ^  ajxj    -    ^  (H-l) 

Xj   e    {0,1}  Vjeiv. 

NOTE:  The  version  of  the  knapsack  problem  where  the  x3  are  general  integer  variables  is 
not  considered  in  this  dissertation. 

•  The  LP  relaxation  of  an  integer  program  IP(0)  is  an  LP,  LP(0),  which  is  identical 
to  IP(0)  except  that  integer  variables  are  replaced  with  appropriately  bounded 
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continuous  variables.  For  example,  the  LP  relaxation  of  the  knapsack  problem 
(Il.l)is 

maximize     Y,  CjXj 

subject  to:     Y  ajxj    ^    & 

0   <   Xj     <     IVjGJV. 

•  The  knapsack  inequality  is 

Y^  *j*i  <  b>  (H.2) 

where  a,j  and  b  are  positive  integers,  Xj  are  binary  variables,  and  TV  =  { 1, . . . ,  n} . 

•  The  integer  polytope  P  associated  with  a  general  integer  program  is  the  convex 
hull  of  points  that  satisfy 

F  =  coOT{xeZn|Ax<b,Dx  =  d},  (II.3) 

where  Ax  <  b  represents  all  inequalities,  and  Dx  =  d  represents  all  equalities 
in  the  constraint  set  of  the  general  IP  (see  Figure  1). 

•  The  points  x1,  ...,xfc  £  Rn  are  linearly  independent  if  the  unique  solution  of 

k 

Y  A*x*  =  0  is  A2  =  0  for  i  =1, ...,  k. 
i=i 

•  The  points  x1,  ...,xfc  G  Rn  are  affinely  independent  if  the  unique  solution  of 

k  k 

Y^  AiX2  =  0,  ^  At  =  0  is  Aj  =  0  for  2  =1, ...,  k. 

•  The  following  statements  are  equivalent: 

a.  x1, ...,  xfc  €  i?n  are  affinely  independent. 

b.  x2  -  x1,  x3  -  x1, ...,  xfc  -  x1  are  linearly  independent. 

•  The  dimension  of  a  polytope  P  is  k  if  the  maximum  number  of  affinely  indepen- 
dent points  in  P  is  k  +  1 . 

•  The  knapsack  polytope  P  associated  with  (II. 2)  is  the  convex  hull  of  0-1  points 
that  satisfy  (II.2): 

P  =  conv  I  x  €  {0,  l}n  |]T  a^  <  6  I  .  (II.4) 

I  ieJV  J 

(This  is  just  a  special  case  of  (II.3)  where  the  variables  are  binary  and  the  con- 
straint set  consists  of  one  knapsack  constraint.) 

Assumption  1 :  It  is  assumed  that  the  dimension  for  the  knapsack  polytope  P  is 
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d  =  n,  which  is  true  if  and  only  if  a,  <  b,  V  j  e  N  (Balas  and  Zemel,  1978). 

•  A  facet  of  the  integer  polytope  P  (II  .4)  is  an  inequality  of  the  form 

y^  Wjij  <  w0  en. 5) 

that  is  satisfied  by  every  x  €  P,  and  satisfied  at  equality  by  exactly  d  affinely 
independent  points  x  e  P.  where  d  is  the  dimension  of  P. 

•  A  valid  inequality  for  an  IP  is  an  inequality  of  the  form 

/J    UjXj  <  ujq  (II.6) 

jescN 

which,  when  added  to  the  constraint  set  of  the  IP,  does  not  exclude  any  feasible 
solution  to  the  IP 

•  A  cut  for  an  IP  is  a  valid  inequality  that,  when  added  to  the  IP,  eliminates  some 
fractional  solution  x  to  the  LP  relaxation  of  the  IP  The  valid  inequality  (II. 6)  is 
also  a  cut  if 

(Cuts  are  also  referred  to  as  "violated  valid  inequalities,"  where  the  violation  is 

J2  UjXj  -  w0.) 

2.  Lifting  and  Tightening  Valid  Inequalities 

The  two  processes  of  lifting  and  tightening  a  valid  inequality  are  used  throughout 
the  literature  on  constraint  generation,  but  their  definitions  often  differ  between  papers.  For 
the  purposes  of  this  dissertation,  we  will  make  a  clear  differentiation  between  the  two  terms. 

•  Lifting  is  the  process  of  extending  a  valid  inequality  for  an  IP  to  include  as  many 
additional  variables  as  possible  without  eliminating  any  feasible  integer  solu- 
tions. Every  variable  that  is  added  to  (lifted  into)  the  valid  inequality  may  enable 
the  extended  valid  inequality  to  eliminate  more  of  the  feasible  region  associated 
with  the  LP  relaxation  of  the  IP  For  example,  suppose  that  by  some  means  an 
initial  valid  inequality 

X!  +  x2  +  x3  <  2  (II.7) 

is  obtained  for  the  following  knapsack  problem: 
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maximize  10xi  +  12x2  +  15x3  +    9x4 
subject  to:  3xi  +    4x2+    7x3  +  10x4    <    12 


X 


3 


{0,1},  j  =  1,2,3,4. 


The  valid  inequality  (II. 7)  indicates  that  at  most  two  of  the  variables  Xj,  j  — 
1,  2,  3,  may  be  set  to  1  without  violating  the  knapsack  constraint.  One  lifting 
process  (called  "simple  lifting"  in  this  dissertation)  extends  the  valid  inequality  to 
include  all  variables  that  have  constraint  coefficients  greater  than  or  equal  to  the 
largest  constraint  coefficient  of  the  variables  in  the  valid  inequality.  Since  the  co- 
efficient on  x4  is  greater  than  the  maximum  of  the  coefficients  on  Xj,  j  =  1,2,3, 
the  valid  inequality  (II. 7)  may  be  lifted  (extended)  by  including  the  variable  x4  : 


X\  +  X2  +  X3  +  x4  <  2. 


The  process  of  tightening  a  less-than-or-equal-to  valid  inequality  increases  the 
coefficients  of  the  variables  from  their  current  value  to  a  higher  integer  value  if 
it  can  be  done  without  eliminating  any  feasible  integer  solutions.  A  continuation 
of  the  lifting  example  demonstrates  this,  using  the  valid  inequality 

X\  +  X2  +  X3  +  x4  <  2. 


If  x4  is  set  to  1,  no  other  variable  in  the  valid  inequality  can  be  set  to  1  without 
violating  the  knapsack  constraint.  Thus,  x4  can  be  assigned  a  coefficient  of  2 
without  excluding  any  valid  solutions,  and  the  tightened  valid  inequality  is 

x\  +  X2  +  X3  +  2x4  <  2. 


3.  Covers  and  Cover  Cuts 

All  definitions  in  this  section  refer  to  the  knapsack  inequality  (II. 2)  and  the  associ- 
ated knapsack  polytope  P  (II. 4). 

•  A  cover  is  a  set  S  C  N  such  that 


i€5 
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•  A  minimal  cover  5  is  a  cover  such  that 

y        dj  <  b,  V  i  G  S. 
3£S-{i} 

•  A  minimal  cover  valid  inequality  is  a  valid  inequality  that  corresponds  to  the 
minimal  cover  5  : 

J2  xj  <  \S\  -  1.  (II.8) 

•  The  extension  o/S  (to  N)  is  defined  as  E(S)  =  S  U  5,  where 

5  =  {i  e  N  -  S  I  en  >  a,j  V  j  6  5}. 

•  An  extended  minimal  cover  valid  inequality  is  a  valid  inequality  that  corresponds 
to  extension  of  5  : 

y~]  xj  <  \s\  - 1. 

•  A  minimal  cover  cut  is  a  minimal  cover  valid  inequality  for  which 

Y^  £j  >\S\-l  (H.9) 

where  x3  is  the  jth  component  of  x,  the  solution  vector  of  the  LP  relaxation  of 
the  MIP 

•  A  lifted  minimal  cover  cut  is  a  minimal  cover  valid  inequality  for  the  minimal 
cover  S  extended  from  (II. 9)  for  which 

]£    Xj  >  \S\  -  1. 

jeE(S) 

•  A  strong  cover  S'  is  a  minimal  cover  for  which  either 

E(S')  =  N 


or 

where 
and 


j€S'-{jmax) 


Jmax  =argmax  dj 


a,  a„  =     max      a^ 

lmax       ieN-E(S') 


31 


A  tight  strong  cover  is  a  strong  cover  S'  such  that 

]T  a,j  -  b  =  1. 

A  strong  cover  valid  inequality  is  a  minimal  cover  valid  inequality  (II. 8)  based 
on  the  strong  cover  5': 

j€S' 

A  strong  cover  cut  is  a  lifted  strong  cover  valid  inequality: 

J2    Xj<\S'\-l. 
jeE(S') 

Note  that  the  strong  cover  cut  must  be  a  lifted  strong  cover  valid  inequality  to 
ensure  the  valid  inequality  is  violated.  (This  is  explained  in  more  detail  in  Chapter 
III.) 


B.         TEST  PROBLEMS 

This  section  gives  the  formulations  for  the  test  problems  that  will  be  used  to  evaluate 
the  effectiveness  of  the  computational  techniques  developed  in  this  dissertation. 

1.  The  Generalized  Assignment  Problem 

One  type  of  IP  used  for  testing  is  the  Generalized  Assignment  Problem  (GAP).  This 
problem  arises  in  a  number  of  contexts  (e.g.,  Amini  and  Racer  1994,  Ross  and  Soland  1975) 
but  is  described  here  as  a  minimum  cost  assignment  of  orders  to  trucks.  Each  order  must 
be  delivered,  and  the  number  of  orders  any  truck  can  deliver  is  constrained  by  the  amount 
of  time  the  truck  has  available  to  make  deliveries.  It  is  assumed  that  deliveries  are  made 
from  a  single  depot  and  that  each  order  o  requires  one  out-and-back  trip  of  known  duration. 
Any  order  may  remain  undelivered  although  a  large  penalty  cost  will  be  incurred  if  this 
happens.  For  notational  convenience,  each  non-delivery  is  modeled  as  a  delivery  by  a  high- 
cost  phantom  truck  t  that  could  deliver  all  orders  by  itself.  Actual  data  from  the  petroleum 
industry  and  a  set  of  randomly  generated  GAPs  will  be  used  for  tests.  All  data  is  integer 
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except  for  costs  and  penalties. 


Indices: 

o  G  O  is  the  set  of  orders  to  be  delivered, 

t  e  T  is  the  set  of  trucks  that  can  make  the  deliveries, 

Ot  is  the  set  of  orders  that  truck  t  is  capable  of  delivering, 

T0  is  the  set  of  trucks  with  which  order  o  can  be  delivered. 

Given  data: 

cot     is  the  cost  of  delivering  order  o  with  truck  t,  and 
hot    are  the  hours  (in  tenths)  required  by  truck  t  to  deliver  order  o, 
Ht    are  the  hours  (in  tenths)  available  on  truck  /,  Ht>  =  oo . 

Decision  variables: 
xot    is  1  if  order  o  is  delivered  by  truck  t,  and  is  0  otherwise. 


Formulation: 

minimize      £  E  cotXot 

ozoteT 
subject  to:  ^  xof    =     1  V  o    e     O 

E   hltXot     <     Ht  V*     e     T 

o£Ot 

xot   e    {0,1}   Vo   €   o,  te  t0. 


(ORDERS) 
(TRUCK-HOURS) 


2.  The  Generalized  Generalized  Assignment  Problem 

This  dissertation  also  considers  the  generalization  of  the  GAP  (GGAP)  with  elastic 
truck  hour  constraints.  These  constraints  allow  penalized  overtime  on  each  truck. 
Indices:  Same  as  GAP 


Given  data:  Same  as  GAP  with  these  additions: 

Ht     is  the  maximum  number  of  regular  time  hours  (in  tenths)  that  truck  t  may  operate, 
H\    is  the  maximum  number  of  overtime  hours  (in  tenths)  that  truck  t  may  operate, 


Decision  variables:  Same  as  GAP  with  these  additions: 
yf    overtime  hours  (in  tenths)  for  truck  t 
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Formulation: 
minimize      ]T  £  cotx0t    +  E  vtzt 

oGO  t<ET  t£T 

subject  to:  ^  xot  =1  V  o    e    O 

teT0 
J2   hotxot  -zt     <     Ht  Vt     €     T 

xot  G     {0,1}  Vo     €     O, 

*t+     €      {0,1,...,  Jf/}     V*     G     T 

Note  that  two-sided  elastic  constraints  can  also  be  used  to  penalize  under-utilization  of 
trucks. 
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III.         KNAPSACK  CUTS 

We  use  knapsack  cutting  planes  in  composite  enumeration  because  knapsack  con- 
straints occur  often  in  IPs,  they  are  relatively  easy  to  work  with,  and  their  valid  inequalities 
and  cuts  have  been  extensively  studied  in  the  literature.  Despite  extensive  study,  effec- 
tive and  efficient  procedures  to  find  and  apply  knapsack  cuts  have  been  lacking.  In  this 
chapter,  we  develop  new  techniques  for  finding  and  lifting  cuts  from  individual  knapsack 
constraints.  We  describe  an  algorithm  that  finds  a  maximally  violated  minimal  cover  cut 
for  a  knapsack  constraint  if  such  a  cut  exists,  an  algorithm  that  lifts  a  minimal  cover  cut 
to  a  lifted  minimal  cover  cut  and  we  develop  a  new  lifting  procedure  called  "interior  lift- 
ing" that  lifts  a  lifted  minimal  cover  cut  to  a  strong  cover  cut  (a  lifted  strong  cover  valid 
inequality).  We  adapt  polynomial-time  facet-finding  algorithms  to  tighten  strong  cover  cuts 
to  violated  facets,  identifying  conditions  and  creating  procedures  that  streamline  the  facet- 
finding  process. 

We  identify  a  new  type  of  knapsack  cut,  the  "non-minimal  cover  cut,"  a  cut  that  can- 
not be  found  by  solving  the  traditional  minimal  cover  separation  problem  (e.g.,  Crowder,  et 
al.  1983).  We  develop  non-minimal  cover  cut-finding  procedures  and  a  new  lifting  proce- 
dure called  "deficit  lifting."  Deficit  lifting  creates  a  violated  extended  minimal  cover  valid 
inequality  from  a  non-minimal  cover  cut,  if  necessary.  All  non-minimal  cover  cuts  can  be 
lifted  and  tightened  to  facets  in  polynomial  time.  The  complete  procedure  of  cut-finding, 
lifting  and  tightening  for  either  a  minimal  or  non-minimal  cover  cut  produces  a  violated 
facet  in  pseudo-polynomial  time. 

A.         FINDING  A  MINIMAL  COVER  CUT 

All  cutting  planes  for  MIPs  must  meet  two  criteria:  (a)  They  must  be  valid  inequali- 
ties that  do  not  eliminate  any  of  the  feasible  solutions  to  the  MIP  when  added  to  the  problem, 
and  (b)  they  must  cut  away  x,  the  current  fractional  (MlP-infeasible)  solution  to  the  LP  re- 
laxation. We  focus  on  the  minimal  cover  valid  inequality  (MCVI)  because  it  has  been  the 
foundation  of  many  of  the  important  results  concerning  the  knapsack  polytope.  In  particular, 


35 


an  MCVI  can  always  be  lifted  and  tightened  to  a  facet  of  its  associated  knapsack  polytope. 
Because  we  seek  an  MCVI  that  is  also  a  cut,  we  want  a  violated  MCVI  which  we  call  a 
"minimal  cover  cut"  (MCC).  Two  conditions  must  be  satisfied  before  attempting  to  find  an 
MCC.  First,  the  solution  to  the  LP  relaxation  x  must  be  fractional.  Second,  the  knapsack 
constraint  that  we  will  generate  cuts  from  must  have  at  least  one  x3  fractional.  If  those  two 
conditions  are  met,  we  attempt  to  find  an  MCC  for  the  candidate  constraint.  Because  we 
want  any  facet  generated  through  our  lifting  and  tightening  algorithms  to  have  the  largest 
violation  possible,  we  begin  the  facet-generation  process  by  finding  an  MCC  that  is  maxi- 
mally violated,  and  if  found,  call  it  a  "maximally  violated  minimal  cover  cut"  (XVMCC). 
We  describe  the  XVMCC-finding  problem  next,  and  outline  an  algorithm  for  its  solution. 

1.  Maximally  Violated  Minimal  Cover  Cut-Finding  Problem 

We  solve  the  XVMCC-finding  problem  with  dynamic  programming,  which  requires 
that  the  knapsack  constraint  have  integral  data.  Before  formulating  the  cut- finding  problem, 
we  review  the  pertinent  definitions. 

Recall  that  the  knapsack  constraint  is  defined  as 

y^  ajXj  <  b,  (III.l) 

where  a3  and  b  are  positive  integers,  a3  <  b  V  j  G  N,  x3  are  binary  variables,  and  N  = 
{1, ...,  n}.  A  cover  for  (III.l)  is  a  set  S  C  N  such  that 

J2  aj  >  b,  (HL2) 

and  a  minimal  cover  S  is  a  cover  such  that 

]T     a3  <  b,  V  i  €  S.  (III.3) 

j£S-{i} 


The  MCVI  is  written  as 


£*j<|S|-l. 
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2.  Cut-Finding  Problem  Formulation 

In  order  to  find  an  XVMCC,  we  must  identify  a  knapsack  constraint  of  the  MIP  that 
has  at  least  one  variable  with  a  fractional  LP  solution  value  Xj.  Once  a  suitable  constraint 
is  found,  we  solve  the  following  cut-finding  problem: 

Indices: 

j      e  N  =  {1,  2, 3,  ...n}  variable  index  for  the  knapsack  constraint 
N+    =  {  j  e  N  \  Xj  >  0}  where  x  is  the  solution  of  the  LP  relaxation  of  the  MIP 

Given  data: 

£j    value  for  Xj  in  a  solution  of  the  LP  relaxation  of  the  MIP 

dj    knapsack  constraint  coefficient  of  Xj 

b     right-hand  side  of  the  knapsack  constraint 

Decision  variables: 

hj     1,  ifxj  is  placed  in  the  minimal  cover  inequality;  0  otherwise 

r     a  general  integer  variable  that  becomes  the  right-hand  side  of  the  XVMCC 

Formulation: 


maximize  V^  £jhj  - 

j€N+ 

-  r 

(III.4a) 

subject  to:  y_.  aj^j 

j£N+ 

>     b+1 

(III.4b) 

Yl  aJhj 

<     b  +  amm 

(III.4c) 

j€N+ 

-  r 

=     1 

a       /  n    1  "l    W  A :   c 

-    \T+ 

(III.4d) 

r     e      {0,1,2,..., |iV+|-l}, 

where  amin  =  min   a7. 

je  n+ 

The  following  list  explains  the  relationship  of  the  constraints  to  the  minimal  cover 
cut  that  we  seek. 

(1)  Constraint  (III.4b)  ensures  that  the  right-hand  side  of  the  constraint  is  covered 
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as  required  by  (III.2): 

y      djhj  >  b  +  1  <=$>  y      djhj  >  b. 
jeN+  jgn+ 

(2)  Constraint  (III. 4c)  ensures  that  the  cover  is  minimal  as  required  by  (III.3).  If  the 
right-hand  side  is  no  longer  covered  when  the  element  with  the  minimum  coefficient  in  the 
cover  is  removed,  it  will  not  be  covered  if  any  other  a7  >  amin,  j '  e  N+  is  removed: 

/J    a3hj  ~  amin  <  b  «=>  22    aJkJ   -  b  +  amin" 

j€N+  j£N+ 

where  amin  =  min   a, .  To  ensure  that  all  minimal  cover  cuts  are  found,  we  actually  solve 

j€N+ 

the  cut-finding  problem  \N+\  times  with  each  a3  =  amin,  j  e  N+  and  requiring  hj  =  0  for 
every  a3  <  amin.  (Actually,  we  need  to  solve  the  cut- finding  problem  only  |7V+|  —  p  times, 
where |  N+ 1  -  p  is  the  number  of  distinct  a.j,  j  e  N+.) 

(3)  Constraint  (III.4d)  sets  the  right-hand  side  r  of  the  prospective  cut: 

r  =  E  hj-l  =  \S\-l. 
3eN+ 

(4)  A  violated  MCVI  has  been  found  if 

y      Xjh*  —  r*  >  0, 

where  h*  and  r*  solve  the  cut-finding  problem. 

3.  Dynamic-Programming  Reformulation 

We  reformulate  the  cut-finding  problem  in  order  to  solve  it  with  dynamic  program- 
ming. We  can  combine  (III. 4a)  and  (III.4d)  by  solving  (III.4d)  for  r,  and  substituting  for  r 
in  (III. 4a).  Also,  (III.4b)  and  (III. 4c)  can  be  combined  into  a  two-sided  constraint.  Thus, 
the  actual  cut-finding  problem  we  solve  is: 
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maximize  J2    {£j  ~  l)^ 

subject  to:    6  +  1   <    £    a3h3     <    b  +  amin  (III.5) 

jeN+ 

^    g    {0,1}  VjeN+, 

where  the  problem  is  solved  |7V+|  times  with  each  a3  =  amin,  j  e  iV+  and  requiring 
hj  =  0  for  every  a3  <  amin.  A  cut  is  found  if  the  objective  function  value  is  greater  than 
- 1 .  Note  that  this  formulation  is  similar  to  the  constraint  identification  problem  of  Crowder 
et  al.  (1983)  except  that  our  requirement  for  integral  data  allows  us  some  simplifications. 

The  reformulation  (III. 5)  can  be  solved  via  this  standard  dynamic  programming  re- 
cursion: 

DP  Recursion  1 

Initial  conditions: 

do(0)  =  0 

do(a')  =  —  oo  for  a'  =  1, ...,  b  +  amm 
dk{a')  =  -oo  for  all  k,  a'  <  0 

Recursion: 

dk{a')  =  max  {dk_i{a'),  dk^a'  -  ak)  +  (xk  -  1)} 

for  k  =  1, ...,  |Ar  +  |  ;  a'  =  0, ...,  b  +  amin. 
The  solution  to  the  problem  is 

v*  =      max       d\\r+\(a'). 

b+l<a'<b+at      '        ' 

If  v*  >  —  1,  then  an  XVMCC  has  been  found,  and  the  corresponding  mini- 
mal cover  variables  and  the  value  of  r*  can  be  recovered  through  auxiliary  data  structures 
within  the  dynamic  programming  algorithm. 

B.         LIFTING  A  MINIMAL  COVER  CUT  TO  A  STRONG  COVER  CUT 

In  order  to  obtain  a  violated  facet  of  the  knapsack  polytope,  we  begin  with  an 
XVMCC,  and  apply  two  lifting  processes  and  one  of  two  tightening  processes.  This  section 
describes  the  two  lifting  processes  which  create  a  strong  cover  cut  from  a  minimal  cover 
cut. 
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1.  Simple  Lifting 

Simple  lifting  adds  variables  to  the  original  minimal  cover  cut,  possibly  enabling 
more  IP-infeasible  fractional  solutions  to  be  eliminated  from  subsequent  solutions  of  the 
LP  relaxation  of  the  MIP  The  resulting  strengthened  minimal  cover  cut  is  called  a  "lifted 
minimal  cover  cut"  (LMCC).  This  lifting  process  can  be  performed  on  any  MCVI,  and  is 
accomplished  by  forming  the  extension  of  the  minimal  cover  S  using  the  following  proce- 
dure. The  justification  follows  the  procedure  statement.  (This  procedure  is  very  simple,  but 
is  stated  formally  for  later  reference.) 

PROCEDURE  1  (Simple  lifting  algorithm):  This  algorithm  takes  the  coefficients  of  the 
knapsack  constraint  with  index  set  N,  and  the  minimal  cover  S  and  returns  the  index  set 
E(S),  the  extension  of  the  minimal  cover. 

Input:  The  index  set  of  the  cover  S,  and  the  vector  of  constraint  coefficients  a,j,  j  €  TV. 

Output:!?  (S),  the  extension  of  the  minimal  cover  S, 

Begin 

ajmax    =   maQX  a3 

S  =  {i€N-S\ai>ajlDax} 
E(S)  =  SuS 
Return  E{S) 
End 

Given  E(S)  from  Procedure  1,  the  LMCC  is 

Y^   xj  <  \S\  -  1.  (IH.6) 

Note  that  because  S  C  E(S),  and  the  right-hand  side  of  the  original  MCC  is  the 
right-hand  side  of  (III. 6), 

jeE(S) 
and  (III. 6)  is  a  cut. 

Justification  for  Procedure  1: 

For  the  MCC's  minimal  cover  5 

y   a,j  >  6, 
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Yl     o,-<6,  Vjfc€5, 

i€S-{jfc} 
and  the  MCC  is 

]T  x,  <  \S\  -  1. 

If  we  add  any  xt,  i  e  N  -  S  with  at  >  max  a,-,  there  still  can  be  no  more  than  151  -  1 
variables  x ;  that  can  be  set  to  1 ,  and  thus 

]T    x,  <  |5|  -  1 

J€B(5) 

is  also  a  valid  inequality. 

Example  1  (part  a):  Suppose  the  solution  to  the  LP  relaxation  of  a  MIP  with  knapsack 

constraint 

Ax i  +  4x2  +  2x3  +  2x4  +  5x5  +  3x6  +  9x7  +  3x8  +  8x9  <  10 

is 

1 

x\  =  -,%2  =  1,^3  =  I.X4  =  l,Xj  =  0  V  J  >  4. 

The  knapsack  constraint  contains  one  fractional  variable.  The  solution  to  (III. 5)  yields  the 
minimal  cover  S  =  { 1,  2, 3, 4}  and  the  MCC  is 

Xl  +  X2  +  X3  -+-  X4  <  3. 

Using  input  S  =  {1,2,3,4}  and  N  -  S  =  {5.6,7,8,9},  Procedure  1  computes  S  = 
{5,  7,  9}  and  returns  E(S)  =  S  U  S  =  {1,  2, 3,  4,  5,  7, 9}  .  The  initial  MCC  has  now  been 
lifted  to  an  LMCC: 

xi  +  x2  +  X3  +  x4  +  x5  +  x7  +  Xq  <  3. 
End  of  Example  1  (part  a) 

2.  Interior  Lifting 

The  linchpin  of  our  facet-finding  process  is  a  procedure  we  call  "interior  lifting." 
Interior  lifting,  unlike  simple  lifting,  affects  the  composition  of  the  base  cover  (the  minimal 
cover  S  found  by  the  XVMCC)  because  it  lifts  variables  into  the  LMCC  that  have  constraint 
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coefficients  smaller  than  a;max  =  max  a, .  At  the  conclusion  of  interior  lifting,  the  indices 
corresponding  to  the  \S\  smallest  constraint  coefficients  in  the  revised  LMCC  form  a  strong 
cover  S'  for  the  constraint. 

Again,  we  review  some  of  the  key  definitions.  Recall  that  a  strong  cover  S'  is  a 
minimal  cover  for  which  either 


E{S')  =  N  (III.7) 

or 

J2       a>  +  awx  <  b,  (III.8) 

j€S'-{jmax) 

where 

Jmax  =arg  max  Uj 
and 

atmax    =         maX  ai- 

ieN-E(S') 


Given  TV,  coefficients  a,,  V  j  €  AT,  a  minimal  cover  S,  and  E(S),  the  following  in- 
terior lifting  procedure  creates  a  strong  cover  cut  from  a  lifted  minimal  cover  cut. 

PROCEDURE  2  (Interior  lifting  algorithm):  This  algorithm  takes  TV,  aj:  V  j  e  N,  S, 
and  E(S)  and  returns  the  extension  of  a  strong  cover  E(S'). 

Input:  TV,  ah  V  j  e  N,  S,  and  E(S). 

Output:  E(S'),  the  extension  of  a  strong  cover  S' 

Begin 

S0  =  S. 

E(S0)  =  E(S). 

So  =  E(Sq)  —  Sq. 

g  =  0 

While  g  <  \N  -  E(S0)\  -  1 


Jmax 

=argmax  a3 

3£Sg 

ain     = 

max      a7- 

9 

jGN-E(Sg) 

If  ain 

<b-         Yl         a3 

j£Sg-{jm»x} 

Go  to  TERMINATE 

Else 
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S?+l  —  Sg  +  {^p}  -  Umax} 
£>g+l  =  *->p    i     iJmax/ 

Endif 
Endwhile 

TERMINATE:  Return  E(S')  =  Sg  U  Ss. 
End 

Ifana^,zp  €  iV-£(S)  is  found  such  that  ais  <  b-         J]        a;,  condition  (III. 8) 

j£Sg-{jmax} 

is  met.  If  all  a,9  >  b-  £  aj5  #  =  0, 1, ...,  |iV  -  E{S0)\  -  1,  then  condition  (III. 7) 
is  met.  In  either  case,  the  resulting  cover  is  a  strong  cover,  and  the  variables  corresponding 
to  a  lifted  strong  cover  valid  inequality  enable  the  formation  of  a  strong  cover  cut 

JZE(S') 

where  S'  is  a  strong  cover.  Note  that 

J2  *j  <  \S'\  ~  1 
jes' 

is  a  strong  cover  valid  inequality,  but  may  not  be  a  cut  because  some  or  all  of  the  variables 
with  positive  LP  solution  values  may  have  been  removed  from  the  original  minimal  cover 
S  and  placed  in  S'  of  the  strong  cover.  However,  because  all  such  variables  migrated  from 
the  original  cover  into  S',  S  C  E(S')  —  S'  U  S'  and  since  the  right-hand  side  of  the  valid 
inequality  did  not  change,  (III. 9)  is  also  violated. 


Theorem  3.1  Let  E(S)  be  the  extension  of  a  minimal  cover  for  (III .  1)  corresponding  to 
a  minimal  cover  cut.  If  S  is  not  strong,  successive  minimal  covers  can  then  be  created 
using  Procedure  2  that  will  result  in  the  formation  of  the  extension  a  strong  cover  E(S'). 
Furthermore,  this  extension  will  correspond  to  a  strong  cover  cut.  (Thus,  we  start  and  end 
with  a  violated  valid  inequality.) 


Proof.  If  So  =  S  is  not  strong,  there  is  some 

atmax   <   ajmax,         ?;max   e   N  -  E(S0) 
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such  that 

jSS'o-Omax} 

where 

jmax  =arg  max  a; 

and 

&im^  =     max      a; 
w     ie;v-£(So) 

Recall  that  £(50)  =  50  U  S0  where 

So  =  {i  E  N  -  S0  \  at  >  ajt  Vj  €  S0} 
Since 

fltmax    >    b   ~  Yl  a3> 

j  S  So  -{jmax} 

a  new  minimal  cover  S\  is  created 


Si  =  So  -  {jmax}  +  {4ax}  • 

A  new  extension  is  created 

S\  =  So  U  {jmax} 

which  is  valid  because 

aimax    >    <*»!     VZ    G    Si. 

Let  5P  be  the  #th  minimal  cover  obtained  by  applying  this  procedure  iteratively.  If 


jGi>g  —  \Jmax/ 


where 


Jmax  =arg  max  a;- 
and 

a*    =     max      a^, 

9       i£N-E(Sg) 

let 
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Sg+i  =  Sg  -  {jmax}  +  {tg}  , 

and 

Sg+l  =  Sg  U  {jmax}  • 

The  procedure  may  terminate  before  examining  all  of  the  \N  -  E(So)\  coefficients. 
Suppose  at  iteration  k 

alk<b-         Y^        ah 


where 


j€Sfc-{jfmax} 


aik  =     max      aj. 


Then, 


iGN-E(Sk) 


^        aj  +  ai  <  b  Vi  e  N-E{Sk), 

j£Sk-{jmax} 


condition  (III.  8)  is  met,  and  5'  =  S*  is  therfore  a  strong  cover.  If  all  \N  —  E(So)\  =  p  co- 
efficients are  lifted  in,  E(SP)  =  N,  condition  (III. 7)  is  met,  and  S'  =  Sp  is  a  strong  cover. 
Furthermore,  since  the  index  of  any  variable  that  leaves  the  initial  minimal  cover  must  be- 
long to  the  extension  of  the  strong  cover,  the  lifted  strong  cover  valid  inequality  must  be 
violated  just  as  the  minimal  cover  cut  is,  i.e.,  the  resulting  lifted  strong  cover  valid  inequal- 
ity is  a  strong  cover  cut  for  x.  QED 

Example  1  (part  b)  Continuing  with  Example  1 ,  we  now  must  consider  variables  in  iV  - 
E(S)  (identified  below)  with  coefficients  less  than  aJmax,  where  aJmax  =  max  a,j.  Let  S  = 

max  a  ^g 

So.  We  are  considering  the  constraint 

4xi  +  4x2  +  2x3  +  2x4  +  5x5  +  3x6  +  9x7  +  3x8  +  8x9  <  10 
and  the  cut 

Xi  +  X2  +  X3  +  X4  +  X5  +  X7  +  Xg  <  3, 
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where  S0    =    {1,2,3,4},  S0    =    {5, 7, 9} ,  E(S0)    =    S0  U  S0    =    {1,2,3,4,5,7,9}, 
N  -  E(S0)  =  {6,  8}  ,  and  aimax  =  a\  =  4.  (Note:  aJmax  =  a2  would  also  be  correct.)  Since 
dj  +  ciQ  >  b,  condition  (III. 8)  is  not  met,  and  So  is  not  strong.  Applying  Procedure 
2,  Si  is  now  formed  as 

Si  =  S0  -  {1}  +  {6} 
and  S\  is  formed  as 

5i  =  50  +  {l}. 
Now  we  have  Sx  =  {2,  3,  4,  6}  ,  Si  =  {1,  5,  7, 9}  ,  E(Si)  =  Si  U  Sx  =  {1,  2,  3,  4,  5, 6,  7,  9} 
and  TV-  E(5i)  =  {8}.  Since 

V.         a;-  +  ag   <   6, 
i€5-{jmax} 

5i  is  strong,  so  S'  =  Si  .  The  strong  cover  cut  is 

Xi  +  X2  +  x$  +  x4  +  x5  +  xe  +  x7  +  Xg  <  3.  (III.  10) 

Recall  that  the  initial  cut  began  with  variables  positive  in  the  solution  to  the  LP  relaxation. 

They  were 

1 

X\  =  ~,X2  =  l,x3  =  l,x4  =  1. 

Since  all  variables  from  the  initial  cut  are  in  this  lifted  strong  cover  valid  inequality  and  the 
right  hand  side  of  the  cut  has  remained  the  same,  (III.  10)  is  a  cut. 

Note  that  since  a§  =  ag,  we  can  exchange  x$  with  xg  in  (III.  10).  This  new  valid 
inequality  is  still  violated,  and  would  lead  to  a  different  knapsack  facet  than  the  facet  we 
find  in  the  next  section's  example. 
End  Example  1  (part  b) 

C.         TIGHTENING  A  STRONG  COVER  CUT  TO  A  FACET 

A  strong  cover  cut  that  is  not  a  facet  can  be  tightened  to  a  violated  knapsack  facet 

using  techniques  we  develop  here.  We  call  the  strongest  of  covers  a  "tight"  cover.  A  strong 

cover  is  tight  if  ^  a3  —  b—  1 .  For  strong  cover  cuts  with  tight  covers,  the  facet  coefficients 
jeS' 
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are  u>i  =  1  for  all  i  €  S',  and  are  determined  by  a  simple  rule  based  on  the  value  of  ar  for 
all  i  e  S'  =  E(S')  -  S'.  However,  for  strong  cover  cuts  that  are  not  tight  (  ]T  aj  -  b  >  1), 

determining  the  facet  coefficients  u>t  for  i  e  S'  requires  a  more  complex  procedure.  The 
algorithm  developed  by  Zemel  (1989)  allows  us  to  compute  the  facet  coefficients  for  a 
minimal  cover,  and  we  adapt  it  for  use  on  strong  covers  that  are  not  tight,  allowing  us  to 
make  some  simplifications.  The  recursive  procedure  we  develop  can  be  viewed  as  a  simple 
extension  of  interior  lifting  that  examines  the  constraint  coefficients  ax  of  the  variables  with 
indices  in  S'  and  assigns  to  each  variable  the  appropriate  facet  coefficient  u^.  Thus,  we 
have  two  tightening  results  based  on  the  "tightness"  of  the  strong  cover,  i.e.,  on  the  value 
of  Yl  aj  ~  &>  mat  tighten  strong  cover  cuts  to  violated  facets  of  the  knapsack  polytope. 

1.  Tightening  Result  I 

We  would  like  to  be  able  to  directly  assign  the  appropriate  facet  coefficients  based 
on  the  value  of  aj,  j  e  S'.  However,  this  can  only  be  done  when  the  constraint  coefficients 
a j  meet  certain  conditions.  We  state,  without  proof,  a  theorem  by  Balas: 

Theorem  3.2    (Balas,  1975)  Let  S  =  {j\,  j2, ...,  j\s\}  be  a  minimal  cover  for  (III.  I)  ordered 
sothatajl  <  aj2  <  ...  <  aJlS{.Let  E(S)  bethe  extension  of S,  and  Sh  =  {j\s\-h+i,  J|S|-/i+2, -••,  J|S|}; 
i.e.,  Sh  corresponds  to  the  index  set  of  the  h  largest  coefficients  in  the  ordering  ofS.  Let  N 
be  partitioned  into  No,Ni,...,Nq,  q  =  \S\  —  1,  where 

N0  =  N-  E{S), 
Ni  =  S  U  {?;  e  E{S)  -  S\at  <Y^  aj}, 

j€S2 

Nh  =  I  t  e  E{S)  \^2  aj  <  di  <   ^T,    a.j  \  ,      h  =  2,...,q, 
y  j£Sh  jesh+i      J 

and  define 

ttj  =  hV  j  e  Nk,  h  =0,1,...,$. 
Then,  the  inequality 

Yl  XJ+    Y^    *ixi  -  '5I  ~  l  (III.ll) 

j€S  j€N-S 

is  satisfied  by  all  x  e  P.  Furthermore,  if 

ai<b-      J2      aj,Vi£  Nh,  h  =  0A,...,q,  (111.12) 

j£S-Sh+i 
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then  (III.  11)  is  a  facet  of  P. 

Remark.  Condition  (III.  12)  implies  that  S  is  a  strong  cover. 

Note  that  Balas'  condition  (III.  12)  really  imposes  a  much  stronger  condition  than  a 
strong  cover.  The  only  requirement  for  a  strong  cover  is 

^2    aj + aw  < b 

j<ES'-{jmax} 

where 

jmax  =arg  max  aj 

jGS' 

and 

Q-irr,.^  —     max      a; 
w      iEN-E(S>) 

This  is  equivalent  to  a*  <  b  —     ^     aj,V  i  e  No,  which  is  only  one  of  the  |5|  conditions 

j£S-Si 

of  (111.12). 

Example  2:  Given  the  knapsack  constraint 

5#i  +  5x2  +  6x3  +  6x4  +  7^5  +  8^6  +  9x7  +  10x8  <  11 

and  a  minimal  cover  5  =  {1,  2, 3},  it  is  obvious  that  E(S)  =  N,  and  the  cover  is  strong. 
Balas'  theorem  places  the  entire  extension  in  Ni  =  {4,  5,  6,  7,  8}  yet  only  the  coefficient  of 
£4  meets  condition  (III.  12).  Thus,  the  valid  inequality  derived  by  the  theorem, 

X\  +  X2  +  X3  +  £4  +  X5  +  Xq  +  x7  +  x8  <  2, 

is  not  a  facet.  The  facet,  which  can  be  derived  by  Zemel's  algorithm,  is 

%\  +  x2  +  £3  4-  x4  +  2x5  +  2x6  +  2x7  +  2x8  <  2. 

End  Example  2 

Because  our  goal  is  to  derive  facets,  we  state  the  following  corollary  to  Balas'  the- 
orem, which  shows  that  if  S'  is  a  tight  cover  (i.e.,  J2  a-j  —  b  =  \)  Balas'  theorem  is 
guaranteed  to  derive  a  facet. 

Corollary  3.3    If  S'  is  a  tight  cover,  then  the  inequality  (HI  11)  created  by  Balas '  theorem 
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is  a  facet. 
Proof.    If 

then 

or 


Ylai~b=l> 


j€S' 


53    ay- 1  =  6-       ^      a,-.  (111.13) 

Balas'  theorem  assigns  ■k1  =  h  for  all  i  such  that 

J2aj<^<Y^    aj>Vi€Nh,  a  =  0,l,...,g.  (III.  14) 

Because  of  the  integrality  requirements  for  6  and  all  a3,  (III.  14)  can  be  rewritten  as 

]T  aj  <at  <   ^    o.j-  1,V«  e  Nh,  h  =  0,l,...,q, 
jGS'h  jes'h+l 

which,  substituting  for  the  right-hand  side  using  (III.  13)  yields 

Y^a3<OLi<b-       ^       aJ^1  €  Nh,  h  =  0,  l,...,o, 
&s'h  jes'-s'h+1 

which  are  the  conditions  specified  in  (III.  12).  Thus,  when  Yl  a,-  —  6  =  1,  the  coefficients 
assigned  by  Balas'  theorem  must  meet  conditions  (III.  12),  and  the  derived  valid  inequality 
(III.  1 1 )  defines  a  facet  of  P.  QED 


Note  that  when  the  cover  is  tight,  (III.  13)  allows  (III.  14)  to  be  rewritten  as 
b—     \_.     0Lj<ax<b—       y         ay,Vi  £  Nh,h  —  0, 1,  ...,a. 

We  will  use  these  intervals  in  the  following  procedure  to  assign  facet  coefficients,  but  we 
redefine      ]T      aj  as  the  partial  sum  A(s  —  h),  the  sum  of  the  s  —  h  smallest  aj:  j  e  S' 

j£S>-S'h 

where  s  =  \S'\ . 
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The  following  procedure  applies  Corollary  3.3. 

Given  a  tight  strong  cover  S",  and  the  partial  sums  A{z),  z  =  1, ...,  s,  defined  as  the 
sum  of  the  t  smallest  a,j,  j  e  S',  the  following  algorithm  assigns  facet  coefficients  for  all 
variables  Xj,  j  €  N. 

PROCEDURE  3  (Tightening  algorithm  I):  This  algorithm  takes  a  tight  strong  cover  S' 
and  the  constraint  coefficients  in  S'  =  E(S')  -  S'  and  returns  the  facet  coefficients  uox  V 

teS'. 

Input:  S'  =  E(S')  -  S'  and  S'. 
Output:  ul  for  all  i  €  S' . 

Begin 

Order  i  G  S' such  that  an  <  ai2  <  ...  <  a».g  . 
Order  i  £  S'  such  that  a^  <  aJ2  <  ...  <  a; 

A(0)  =  0. 

Compute  A(z),  2  =  1,2,...,|S"|. 

s  =  \S'\. 

k  =  1 

h  =  l 

Fork  =  1,2,...,  S' 

Ifaifc  <6-A(s-  (/i  +  l)) 
uji  =  h 
Increment  k 
Else 

Increment  h 
Endif 
Endfor 
End 


S' 


The  complexity  of  this  algorithm  is  0(\S'\  log  |5'|)  +  0( 
) ,  which  is  no  worse  than  O  (n  log  n) . 


5' 


log 


5' 


+  0(|5'|  + 


Example  1  (part  c)  Finishing  the  problem  begun  in  the  first  example,  we  first  check 

Y^    a.j  -  b.  Since  Yl    aj  ~  &  =  ^  Corollary  3.3  applies,  and  we  assign  w*  using  Pro- 
ps' j€5' 
cedure  3.  Recall  that  the  constraint  is 


Ax i  +  4x2  +  2x3  +  2x4  4-  5x5  +  3x6  +  9x7  4-  3x8  +  8x9  <  10, 
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the  tight  cover  is  S'  =  {2, 3, 4, 6},  and  the  strong  cover  cut  is 

Xi  +  X2  +  x3  +  X4  +  X5  +  Xq  +  X7  +  Xq  <  3, 

with  E(S')  =  {1,2,  3,  4,  5, 6,  7, 9}  .  We  first  calculate  the  set  of  limits,  and  the  sets  defined 
on  these  limits  to  assign  the  appropriate  coefficient  u>j  for  variable  Xj : 

Nh  =  {ie  E(S')  \b-  A(s-h)  <at<b-  A{s-{h  +  1))}  ,      h  e  {2,  3}  . 

Any  j  €  E(S')  such  that  6  <  a3  <  8  has  ujj  =  2,  so  u;9  =  2  and  any  j  e  E(S')  such  that 
8  <  a 3  <  10  has  ujj  =  3,  so  u>7  =  3.  To  determine  members  of  E(S')  that  are  assigned  the 
facet  coefficient  utj  =  1,  we  use 

N1  =  S'u{ie  E(S')  -  S'  \at<b-A(s-  2)}  . 

Variables  Xj,  j  €  {1,  2, 3, 4,  5, 6}  meet  this  criterion.  The  cut  is  now 

x\  +  x2  +  £3  +  x4  +  x5  +  x6  +  3X7  +  2xg  <  3. 

This  valid  inequality  must  be  a  facet  of  the  polytope  of  the  original  knapsack  constraint 
because  it  satisfies  the  condition  in  the  corollary.  Recall  again  that  we  began  this  tightening 
process  with  a  valid  inequality  which  was  a  strong  cover  cut.  The  variables  positive  in  the 
solution  to  the  LP  relaxation  were 

1 
xi  =  -,x2  =  l,x3  =  l,x4  =  1. 

Since  all  variables  from  the  strong  cover  cut  are  in  this  facet  with  facet  coefficients  Wj  >  1, 
and  the  right  hand  side  of  the  valid  inequality  is  the  same  as  that  of  the  strong  cover  cut, 
this  facet  is  also  a  cut  because 

Yl  *?+  Yl  "& >  i5'i " 1- 

End  of  Example  1  (part  c) 
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2.  Tightening  Result  II 

If  the  strong  cover  is  not  tight,  i.e.,  if 

y     dj  —  b  >  1, 
J€S> 

we  cannot  assign  facet  coefficients  using  Corollary  3.3.  The  recursive  procedure  we  de- 
velop next,  which  is  similar  to  Zemel  (1989)  assigns  the  appropriate  facet  coefficients  in 
polynomial  time.  Zemel  developed  his  algorithm  to  solve  Padberg's  series  of  problems  that 
assign  facet  coefficients.  First,  we  examine  Padberg's  result. 

a.  Padberg's  result 

A  facet-finding  result  by  Padberg  (1975)  has  been  the  foundation  for  many 
of  the  critical  discoveries  of  the  knapsack  polytope.  This  result,  stated  without  proof,  creates 
a  facet  of  the  knapsack  polytope  by  sequentially  lifting  variables  into  an  MCVI. 

Theorem  3.4  (Padberg  1975).  Let  She  a  minimal  cover  for  (III.  1),  let  N-S  =  {ii,  ...,ip} 
be  arbitrarily  ordered,  and  consider  the  sequence  of  knapsack  problems 
KS(ik) defined  recursively  as 

lk-i 
KS(ik)         zik     =    maximize  ^  Xj+  ^  /3{Xi 

subject  to:     ^  a,jXj  +  ^  a^     <     b  —  alk 

xj    e    {0,1}  Vj  e  S 
xt    e    {0,1}  Vi  e  N  -  S 

for  k  —  1, ...,  p  (where  summation  over  the  empty  set  is  0),  with  the  coefficients  (3l  defined 
by 


Then,  the  inequality 


is  a  facet  of  P. 


(3t  =  \S\  -  1  -  Zi,  t  =  ti,  ...,ik-i- 


jes  ieN-s 
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The  theorem  implies  that  a  series  of  |JV  -  S\  IPs  (knapsack  problems)  must 
be  solved  to  determine  the  coefficients  P{. 

b.  Zemel's  result 

Zemel  recognized  that  Padberg's  problem  could  be  solved  in  a  much  simpler 
way.  First,  he  recognized  that  Padberg's  procedure  was  related  to  the  set  of  dual  knapsack 
problems  DKSi(z),  2  =  0, ...,  s  —  1  where  s  =  \S\ . 

DKSik(z)        Aik(z)    =    minimize      ]P  a,jXj+  ^  atXi 

lk-l 

subject  to:        ]T)  Xj+  ^  (3ixl    >    z 

jeS  i=h 

Xj     E     {0,l}Vj€5 

xt     e     {0, 1}  \/i  €  N  -  S 

The  problem/^  S  (ik)  is  related  to  the  set  of  problems  DKSlk(z),  z  =  0, ...,  s  -  1  via  the  re- 
lation ztk  =  max  {z  :  Aik(z)  <  b  —  aik}  . 

ALGORITHM  LIFT  (Zemel,  1989):  This  algorithm  assigns  facet  coefficients  for  all  vari- 
ables Xj,  j '  e  N  in  polynomial  time.  This  algorithm  takes  a  minimal  cover  5,  the  partial 
sums  it,  t  =  1, ...,  s  —  1,  defined  as  follows: 

l\    =    ajx,  where  ji  =argmin  aj 

jeS 

£2    =    lx  +aj2>  where  J2  =argmin  aJt 


ts_i     =    ^_2  +  ajs_1,  where  j5_i  =         argmin  a, 

ies-{ji}-...-0's-2} 

the  right-hand  side  b  and  the  constraint  coefficients  in  S  =  E(S)  -  S  and  returns  the  facet 
coefficients  (3t  V  i  £  S. 

Input:  S  =  E(S)  —  S  (in  any  sequence)  for  a  minimal  cover  S,  the  right-hand  side  6,  a,;  V 
i  G  S,  and  the  partial  sums  £t,  t  =  1, ...,  s  —  1. 

Output:  ^  for  all  i  €  5. 

Begin 

Let  Ai(0)  =  0,  AiW  =  4,  ^  =  1, ...,  s  -  1 
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For  z  =  1, ...,  S 

Z{  =  max  {z  :  Ai(z)  <  b  —  a;} 

Pi  =  S  -  1  -  Zi 

For  z  =  0, ...,  5  —  1 

If  z  <  (3l,Al+l{z)  =  Ai{z) 
Else  Ai+i{z)  =  min  {A^z),  At{z  -  0V .)  +  a{} 
Endif 
Endfor 
Endfor 
End 

The  facet  that  corresponds  to  this  algorithm  is 

Y/x3+Y/pl^<  \s\-i. 

Note  that  the  facet  produced  will  depend  on  the  order  in  which  the  elements  of  S  are 
processed. 

In  practice,  we  will  apply  a  variant  of  Zemel's  algorithm  after  we  have  lifted 
to  a  strong  cover  cut  and  determined  that  the  strong  cover  cut  is  not  tight.  Because  we  begin 
the  process  with  a  strong  cover  cut,  the  facet  we  find  will  be  a  violated  facet. 

c.  Tightening  Algorithm  II 

We  will  modify  Zemel's  algorithm  to  efficiently  tighten  strong  covers.  First, 
by  calculating  (and  updating)  one  additional  sum,  we  may  be  able  to  terminate  the  algorithm 
after  only  assigning  a  few  facet  coefficients,  leaving  the  others  to  be  assigned  by  Procedure 
3,  a  much  simpler  procedure.  The  use  of  this  additional  sum  will  also  allow  us  to  avoid 
many  of  the  checks  min  {Al(z),  At{z  —  /^)  +  aj  made  in  Algorithm  Lift. 

Let  s  =  |5'|  and  define  Ai(s)  =  Y2  aj- 

jes> 

Corollary  3.5    If  Ai(s)  —6  =  1,  then  all  remaining   S'    —  i  facet  coefficients  can  be 
assigned  using  Procedure  3  with  the  current  partial  sums  Ai(z),  z  =  0, 1, ...,  s. 

Proof.  If  Ai(s)  -  b  =  1,  we  will  show  that 

Ai(z  -  (3t)  +  a,  >  Ai(z),  z  =  0,  1, ...,  s. 
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Therefore,  the  assignment 


becomes 


and 


Ai+i{z)  =  min  {Ai(z),  At(z  -  0{)  +  aj 


Ai+i(z)  =  Ai(z), 


Ai+k{z)  =  Ai(z),  k  =  2,..., 


S' 


which  allows  coefficients 


Pi+ki    k  —  1,  ..., 


S' 


to  be  assigned  using  the  partial  sums 


Ai{z),  z  =  0,1,...,  a. 

Suppose  Ai(s)  -6=1,  but  A{{z  -  pt)  +  at  <  Al{z)  for  some  z  =  0^  &  +  1, ...,  s.  We 
know  that  xl  is  assigned  coefficient  pt  when 

At(s  -  1  -  p{)  +  a2  <  b  and  Ai(s  -  P{)  +  a*  >  b. 


Since 


and 


then 


Ai(s  -  /3{)  +  at>  b, 
Ai{s)-l  =  b, 


Ai(s-  Pt)  +at>  Ai(s)  -  1, 
and,  because  of  the  integrality  of  the  data, 

Al{s  -  P^  +at>  Al{s). 

Because  of  the  way  the  partial  sums  were  formed  and  updated,  we  know  that 

Ai(s)  -  ,4,(5  -  P^  >  Al{s  -  k)  -  At{s  -Pi-  k),  k  =  1, 2, ...,  s  -  ft, 
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and  since 

ai  >  Ai(s)  -  Ai{s  -(3^, 
we  know  that 

at  >  Ai{s  -k)-  Al{s  -fa-  fc),  k  =  1, 2,  ...s  -  p{. 

Equivalently 

Al(s  -  0{  -  k)  4-  a,  >  Ai(s  -  k),  k  =  1, 2,  ...s  -  ft 
which  is  a  contradiction.  There  cannot  exist  Ai(z  -  P{)  +  a;  <  -4j(z)  for  any  z  =  1, ...,  s. 
So, 

4|5|(z)  =  ^|§i_iW  =  ••■  =  Ai+1{z)  =  Ai(z),  z  =  0,1,... ,s, 
and  all  unassigned  facet  coefficients  can  be  assigned  using  Procedure  3  with  the  current  set 
of  partial  sums  Ai(z),  z  =  0, 1, ...,  s. 

Corollary  3.6    If  en  >  Al(s)  —  Ai(s  —  Pi),  all  partial  sums  used  in  iteration  i  + 1  will  be  the 
same  as  those  used  in  iteration  i  of  Algorithm  Lift,  that  is,  Ai+i(z)  =  Ai(z),  z  =  0, 1, ...,  s. 

Proof.  If  at  >  Ai(s)  -  At(s  -  pt),  we  will  show  that 

Ai(z  -  p^  +  at  >  Ai(z),  z  =  0, 1, ...,  s. 
Therefore,  the  assignment 

Ai+i{z)  =  min  {Al(z),  A{(z  -  0{)  +  aj 

becomes 

Ai+i(z)  =  Ai{z),  z  =  P^  Px  +  1, ...,  s. 
Suppose  al  >  A{{s)  -  Al(s  -  /?,),  but  At(z  -  Pz)  +  at  <  At(z).  Because  of  the  way  the 
partial  sums  were  formed  and  updated,  we  know  that 

,4,(5)  -  At{s  -  p^  >  Al{s  -  k)  -  Ai(s  -Pi-k),k  =  l,2,...,s-Pi 

and  since 

at  >  Al{s)  -Ai(s  -Pi), 
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we  know  that 


at  >  Al(s  -k)-  Ai(s  -fa-k),  k  =  1, 2,  ...a  -  f3t. 


Equivalently 

Ai(s  -  (3t  -  k)  +  a,  >  At{s  -k),  k  =  1,  2,  ...s  -  ft 
which  is  a  contradiction.  There  cannot  exist  Ai(z  —  /3{)  +  a^  <  Ai(z)  for  any  2  =  1, ...,  a. 
So, 

i4i+i(z)  =  Ai(z),  z  =  0,1,..., a, 
and  all  partial  sums  used  in  iteration  1  4-  1  will  be  the  same  as  those  used  in  iteration  %. 
QED 

Corollary  3.7  If the  x;,  i  e  5  Are  assigned  facet  coefficients  in  ascending  order  of  the 
constraint  coefficients  al:  1  €  S,  the  algorithm  can  be  terminated  when  the  first  xr  receives 
facet  coefficient  /3{  =  [|  J  4-  1,  and  the  remaining  xi?  i  €  S  can  be  directly  assigned  facet 
coefficients  using  Procedure  3  with  the  current  partial  sums  Ai(z),  z  =  0, 1, ...,  s  —  1  —  (3^ 

Proof.  When/5,=  [fj  +  1, 

Ai(s-  1-  (|JJ  +l))  <  b-at. 
The  smallest  partial  sum  that  can  be  adjusted  is 

Ai+l(0i)  =  min  {Ai{0i),  At{z  -  (3,)  4-  aj  . 

Because  of  the  imposed  ordering,  al+\  >  a,.  This  means  that  b  -  al+i  <  b  —  ar,  and  thus, 
the  largest  partial  sum  smaller  than  the  difference  b  —  ai+i  can  be  no  larger  than 


+i(*  "  1  "  (|jj  +  l))  =  Ai+i(s  ~  |JJ  "  2). 


Since 


Ai+i(s 


s 
L2J 


-2)<AI+Iq-J  +l)  =  Al+1(Pt), 


the  remaining  i  e  S  will  be  assigned  facet  coefficients  based  only  on  the  partial  sums  that 
will  never  be  adjusted  if  the  procedure  were  allowed  to  continue,  that  is 

i4|§|(z)  =  A^^iz)  =  ...  =  Ai+i(z)  =  Ai{z),\/z  <  (3t. 
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QED 

Given  the  following  corollaries,  we  modify  Algorithm  Lift  to  assign  facet 
coefficients.  We  begin  with  a  strong  cover  S'  that  is  not  tight,  and  define  the  partial  sum  lt, 
t  =  1, ...,  s,  as  the  sum  of  the  t  smallest  a,j,  j  G  S'  where  s  =  \S'\ . 

PROCEDURE  4  (Tightening  algorithm  II):  This  algorithm  takes  the  constraint  coeffi- 
cients in  S'  =  E(S')  —  S'  for  the  partial  sums  £t,  t  =  1, ...,  s  for  a  strong  cover  S'  and 
returns  the  cut  coefficients  w». 

Input:  S'  =  E(S')  -  S'  and  the  partial  sums  £t,  t  =  1, ...,  s  for  a  strong  cover  S'. 
Output:  lo1  for  all  i  e  5'. 

Begin 

Let  Ai(0)  =  0,  Ai(-z)  =  lz,  z  =  1, ...,  s,  and  order  5'  in  ascending  order  of  a,j, 


h  =  2 

For  t  =  1,  2, ..., 

While  h  < 


S' 


+  1 

1=  b  -  Ai(s  -  /i) 
7  =  6  -Ai(s-  (/i  +  l)) 
Hat  <  /_,  then 
Wj  =  h  —  1 
Else 

If  ax  <  I,  then 
uji  =  h 

lfat  <  Ai(s)  -  Ai(s  -  h)  then 
If  2  <  h,  Ai+1(z)  =  Ai{z). 

Else  Ai+i(z)  =  min  {Ai(z),  Ai(z  —  h)  +  aj  ,  z  =  h,h  +  1, ...,  s. 
Endif 
i  =  i  +  1 
IfXi(s)  =  6+1 

Terminate  algorithm  and  assign  remaining 

coefficients  using  Procedure  3  with  current  partial 
sums  Ai(z),  2  =  0,  l...,s. 
Endif 
Endif 
Else 

h  =  h  +  l 
Endif 
Endif 
Endwhile 

Use  Procedure  3  with  current  partial  sums  Ai(z),  z  =  0, 1, ...,  s  to  assign 
remaining  coefficients 
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Endfor 

Return  u){  for  each  i  e  S' 
End 

Once  all  uii  have  been  assigned,  the  strong  cover  cut  has  been  lifted  to 

Y^Xj+^WiXi  <  \S'\-l 

JGS'  i£§' 

which  is  a  violated  facet  of  the  knapsack  polytope. 

We  illustrate  Procedure  4  with  a  simple  example: 
Example  3:  Given  the  knapsack  constraint 

4x\  +  5x2  +  5x3  +  6x4  +  7x5  ■+-  8x5  +  8x7  +  12xs  +  13xg  <  16, 

and  a  strong  cover  is  S'  =  {1,  2,  3, 4}  ,  s  =  4,  the  corresponding  strong  cover  cut  is 

xi  +  X2  +  X3  +  x4  +  x5  4-  xq  +  x7  +  x8  +  xg  <  3. 

and  the  initial  partial  sums  are 

A^O)  =  0,  Ai(l)  =  4,  Ai(2)  =  9,  A!(3)  =  14,  ^(4)  =  20. 

Because  the  smallest  a,  that  can  get  a  facet  coefficient  must  be  greater  than  b— A\(s  —  2)  =  7, 

u5  =  1. 

Since 

b  -  Ai(s  -  2)  <  a6  <  b  -  A^s  -  3), 
u->6  =  2,  and  since 

a6  <  Ai(s)  -  Ai{s  -  2)  —  11, 
we  must  adjust  the  partial  sums  ^2(2): 
For  z  <  2, 

X2(0)  =  i4!(0)  =  0,  A2(l)  =  Ai(l)  =  4 
For  2  =  2,3, ...,  s,  A2{z)  =  min  {^1(2),  Ax{z  -  2)  +  a6}  .  Thus, 

A2(2)    =    min  {9, 0  +  8}  =8, 
A2{Z)    =    min  {14, 4  + 8}  =  12, 
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A2{4)    =    min  {20, 9  +  8}  =  17. 

Since  A2(s)   =  A2(4)  =  17  =  b  +  1,  we  can  assign  the  remaining  coefficients  using 
Procedure  3  with  the  partial  sums  A2(z),  z  =  0, 1, ...,  s.  The  facet  is 

x\  +  X2  +  X3  +  £4  +  x5  +  2a;6  +  x7  +  2x8  +  3xg  <  3. 

End  Example  3 

Next,  we  illustrate  Procedure  4  with  a  more  complex  example: 
Example  4:  Given  the  knapsack  constraint 

40xi  +  41x2  +  42x3  +  43x4  +  44x5  +  75x6  +  115x7  +  140x8  <  170, 

the  strong  cover  is  S'  =  {1,2, 3, 4,  5},  and  the  strong  cover  cut  is 

Xi  +  X2  +  X3  +  X4  +  X5  +  X6  +  x7  +  x8  <  4, 

and  the  initial  partial  sums  are 

Ai(0)  =  0,  Ai(l)  =  40,  Ai(2)  =  81,  Ax{3)  =  123,  Ai(4)  =  166,  Ai(5)  =  210. 

The  first  variable  we  consider  is  xq,  the  variable  with  the  smallest  at  in  S' '.  Because 

b  -  Ai(s  -  2)  <  a6  <  b  -  Ax(s  -  3), 

ujq  =  2,  and  since 

a6  <  Ai(s)  -  Az{s  -  2)  =  87, 
we  must  adjust  the  partial  sums  A2(z): 
For  z  <  2, 

A2(0)  =  ^i(O)  =  0,  A2(l)  =  Ai(l)  =  40. 
For  2  =  2,3, ...,  s,  i42(2)  =  min  {Ai(z),Ai(z  -  2)  +  a6}  .  Thus, 

,4.2(2)    =    min  {81,0  + 75}  =  75 
A2(3)    =    min  {123,  40  +  75}  =  115 
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A2(4)    =    min  {166,  81  + 75}  =  156 
A2(5)    =    min{210, 123  +  75}  =  198. 

Since  A2(s)  =  ^2(5)  =  198  >  b  +  1,  we  cannot  revert  to  Procedure  3. 
We  consider  x7.  Because 

b  -  A2{s  -  3)  <  a7  <  b  -  A2{s  -  4), 

u7  =  3.  We  can  revert  to  Procedure  3  according  to  Corollary  3.7  because  uj7  =  3  =  [|  J  + 1. 

Instead,  we  will  continue  the  process  to  verify  the  correctness  of  Corollary  3.7. 

Since 

a7  <  A2(s)  -  A2{s  -3)  =  123, 
we  adjust  the  partial  sums  again. 
For  z  <  3, 

A3(0)  =  A2(0)  =  0,  A3(l)  =  A2{\)  =  40,  A3(2)  =  A2(2)  =  75. 

For  z  =  3, ...,  s,  A3{z)  =  min  {A2(z),  A2{z  -  3)  +  a7}  .  Thus, 

A3(3)    =    min  {115,0  + 115}  =  115 
A3(A)    =    min  {156,  40+ 115}  =  155 
A3{5)    =    min  {198,  75+ 115}  =  190. 

Since 

.43(5)  =  ^3(5)  =  190  >  b+  1 
we  cannot  revert  to  Procedure  3  (via  Corollary  3.5). 
We  consider  x8.  Because 

b  -  A3(s  -  4)  <  a8  <  b  -  A3(s  -  5), 
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u)8  =  4.  Note  that  the  only  partial  sums  we  use  are 

A3(s-4)  =  A3(1)  =  A2(1) 

and 

A3(s  -  5)  =  A3(0)  =  A2(0). 
In  fact,  if  we  change  the  coefficient  a8  and  let  it  be  the  smallest  possible  value  given  the 
value  of  a 7  and  the  imposed  ordering,  a8  =  115,  we  can  see  that  in  the  worst  case, 

b-A3(s-S)  <a8<b-A3(s-4), 

and  the  only  partial  sums  that  would  be  used  are  ^3(2)  =  ^2(2)  and  ^3(1)  =  ^2(1)-  Thus, 
the  last  adjustment  was  unnecessary,  and  we  could  have  assigned  cj8  =  4  based  on  the 
partial  sums  A2{z),  z  =  0,1.  The  facet  is 

xi  +  X2  +  X3  +  x4  +  x5  +  2x6  +  3x7  +  4x8  <  4. 

End  Example  4 

D.         NON-MINIMAL  COVER  CUTS  FROM  THE  KNAPSACK  POLYTOPE 

Although  a  knapsack  constraint  may  contain  one  or  more  variables  with  LP  solution 
values  Xj  that  are  fractional,  there  is  no  guarantee  that  an  MCC  exists.  In  the  event  no 
minimal  cover  cut  exists  for  a  candidate  knapsack  constraint,  we  develop  a  method  that  finds 
a  "non-minimal  cover  cut"  (NMCC),  if  such  a  cut  exists.  We  distinguish  between  two  types 
of  NMCCs.  A  Type  I  NMCC  only  requires  cut  coefficients  of  1  for  variables  in  the  NMCC, 
and,  if  the  NMCC  is  not  a  violated  "extended  minimal  cover  valid  inequality"  (TMCVI),  it 
is  lifted  by  "deficit  lifting"  (and  possibly  simple  lifting)  to  a  violated  TMCVI  that  is,  in  turn, 
lifted  and  tightened  to  a  knapsack  facet.  Type  II  NMCCs  are  valid  inequalities  that  require 
that  one  or  more  cut  coefficients  be  greater  than  1  to  obtain  a  violated  valid  inequality. 

1.  Non-Minimal  Cover  Cut-Finding  Problem 

Once  a  candidate  knapsack  constraint  is  identified,  the  minimal  cover  cut-finding 
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algorithm  is  invoked.  In  the  event  that  the  algorithm  finds  no  minimal  cover  cut,  the  NMCC- 
finding  algorithm  is  called.  We  define  a  two-step  procedure  that  first  calculates  the  right- 
hand  side  of  a  "non-minimal  cover  valid  inequality"  (NMCVI),  and  then  checks  to  see  if  the 
NMCVI  is  violated  before  any  lifting  or  tightening  is  carried  out.  Given  x,  the  right-hand 
side  uq  is  found  by  solving  the  following  IP  (which  uses  previously  defined  notation): 


Formulation: 


ujq  =  maximize         Yl    xj 

subject  to      Yl    ajxj    ^    k  (III.  15) 


jeN+ 


€     {0,1}  Vj  €  N+. 


The  standard  dynamic  programming  recursion  used  to  solve  (III.  15)  is: 
DP  Recursion  2 

Initial  conditions: 

d0(0)  =  0,  d0(0  =  -oo  for  all  i  ^  0. 

Recursion: 

dk(£)  =  max  {dk-i(t),  dk.x{i  -  ak)  +  1}  for  k  -  1, ....  |7V+|  and  i  =  0, ...,  b. 

The  solution  to  the  problem  is  wJ  =  max  d\N+\(£),  and  the  NMCVI  is 

Yl  *j<  ws-  (m-16) 

The  second  step  of  the  cut-finding  process  is  simply  to  check  the  NMCVI  for  violation.  The 
NMCVI  (III.  16)  is  a  Type  I NMCC  if 

Y  xj-u*0  >  0.  (III.  17) 

An  outline  of  the  two-step  NMCC-finding  procedure  follows. 

PROCEDURE  5  (Non-minimal  cover  cut-finding  algorithm):  This  algorithm  takes  b, 

the  values  of  x3  and  a3,  j  e  N+,  and  returns  luq  and  the  message  that    Yl    x^  <  lj0  is  a 

Type  I  NMCC,  or  returns  the  message  that  no  Type  I  NMCC  exists. 

Input:  The  values  of  Xj  and  a,j,  j  e  N+  and  the  right-hand  side  of  the  constraint  b. 
Output:  The  message  that   Y    xj  <  ^o  is  a  Type  I  NMCC  and  cjq,  or  the 
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message  that  no  Type  I  NMCC  exists. 

Begin 

Find  wo  by  DP  recursion  2 

If  J2    Xj  —  ujq  >  0 

jeN+ 

Return  "NMCVI  is  a  Type  I  NMCC"  and  w0 
Else 

Return  "NMCVI  is  not  a  Type  I  NMCC" 
Endif 
End 

Example  2  (part  a):  Suppose  the  solution  to  the  LP  relaxation  of  a  MIP  with  knapsack 

constraint 

2a; !  +  4x2  +  8x3  +  Sx4  +  8x5  <  10  (111.18) 

is 

xi  =  1,  S2  =  1/4,  £3  =  1/4,  x4  =  1/4,  x5  =  3/8 
The  knapsack  constraint  has  four  fractional  variables,  so  it  is  eligible  to  have  a  cut  derived 
from  it.  Note  that  any  two  of  the  coefficients  a,j,  j  e  {2,  3, 4,  5}  will  form  a  minimal  cover, 
so  there  are  (2)  MCVIs  of  two  variables  with  the  right-hand  side  of  \S\  —  1  =  1  associated 
with  (III.  18).  But,  because  no  sum  of  any  two  Xj,  j  G  {2,  3, 4,  5}  exceeds  1,  no  minimal 
cover  cut  exists. 

The  first  step  to  deriving  a  possible  NMCC  is  to  find  the  right  hand  side  of  the 
NMCVI  by  solving  (III.  15)  with  DP  recursion  2.  The  solution  is  co0  =  2,  and  the  valid 
inequality  is 

x1  +  x2  +  x3  +  x4  +  x5  <  2.  (III. 19) 

Checking  condition  (III.  17)  confirms  that  (III.  19)  is  a  Type  I  NMCC  since 

Xi  +  X2  +  £3  +  X4  +  x5  >  2. 

End  of  Example  2  (part  a) 

2.  Deficit  Lifting 

We  find  a  facet  from  the  Type  I  NMCC  as  we  did  from  the  MCC.  If  the  ui0  +  1 
smallest  o^,  j  G  N+  form  a  minimal  cover,  we  designate  the  indices  associated  with  the 
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u>o  +  1  smallest  ctj,  j  £  N+  as  S  and  employ  Procedures  1-4  as  necessary  to  find  a  violated 
knapsack  facet.  If  not,  we  must  utilize  a  process  called  "deficit  lifting"  to  find  a  TMCVI. 
Deficit  lifting  finds  a  violated  valid  inequality  that  can  be  lifted  to  a  facet  by  exclud- 
ing variables  from  the  Type  I  NMCC.  To  begin,  we  designate  the  variables  with  the  u>o  +  1 
smallest  a3,  j  e  N+  as  members  of  the  (possibly  non-minimal)  cover  S^r. 


PROCEDURE  6  (Deficit  lifting  algorithm):  This  algorithm  takes  S^r,  the  vector  of  con- 
straint coefficients  a3,  j  e  S^r,  the  right-hand  side  of  the  constraint  b,  the  right-hand  side 
of  the  NMCVI  ujq,  and  returns  a  minimal  cover  S^r  and  u>m,  the  right-hand  side  of  the 
NMCVI  corresponding  to  5CM 


CUT' 

'0        „  .    a  t-   CO 


Input:  S^vr,  aj,  j  e  5^r,  u0  and  b. 

Output:  A  minimal  cover  S^r  for  the  constraint. 

Begin 
g  =  o 

For  g  =  0,  l,...,|u;o| 
ai„  =  min  a, 
9     jeBL,    3 

if     E     aj  < b 

go  to  TERMINATE 

Else 

Scvr     =  ^cvr  ~  \l9i 
Ug+1  =  Ug  -  1 

9  =  9  +  1 
Endif 
Endfor 

SetS™r  =  S9cvrandujM  =  u,g 
TERMINATE:  Return  S™T  and  uM 
End 

The  resulting  valid  inequality  is 


J2  **+   Yl   x>  -  w°-  (IIL20) 


Of  course,  it  would  be  pointless  to  lift  a  Type  I  NMCC  with  deficit  lifting  if  the 
resulting  valid  inequality  were  not  violated.  Fortunately,  the  following  result  proves  that  a 
violated  valid  inequality  always  results  from  deficit  lifting  a  Type  I  NMCC. 
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Lemma  3.8    A  valid  inequality  created  from  a  Type  I NMCC  by  deficit  lifting  will  always 
be  violated. 


Proof.  If 


then 


because 


y j    Xj+    \.    %j > uo  —  i, 


2l0  <  1- 

The  result  for  S^r  follows  by  induction  on  M.  QED 

Note  that  (111.20)  is  not  necessarily  a  TMCVI  at  this  point.  The  actual  TMCVI  is 

^2  x3+     2Z     xi  -  lj°- 


However,  since  all  a,  >  ajmax,  i  e  N+  —  S^r  where  aJmax  =  max  a,j,  then  7V+  -  5^r  C 
£"  ( S^r )  -  S^fr ,  and  it  is  a  simple  task  to  use  simple  lifting  (Procedure  1 )  to  lift  any  remaining 
variables  that  belong  in  the  TMCVI.  After  a  TMCVI  is  completely  formed,  interior  lifting 
(Procedure  2)  and  tightening  (Procedure  3  or  Procedure  4)  will  create  a  facet,  just  as  they 
did  with  a  lifted  minimal  cover  cut. 

We  continue  with  example  2  to  demonstrate  deficit  lifting: 
Example  2  (part  b):  We  have  the  knapsack  constraint 

2xx  +  4x2  +  8x3  +  8x4  +  8x5  <  10,  (111.21) 

with  LP  solution  values 

xi  =  1,  x2  =  1/4,  x3  =  1/4,  x4  =  1/4,  x5  =  3/8, 

and  the  NMCC 

X\  +  X2  +  X3  +  X4  +  x5  <  2. 

Since  u;0  =  2,  we  form  S^r  =  {1,  2,  3}  .  Since  a\  =  aiQ  =  min    aj,  the  first  iteration  of 
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Procedure  5  finds  that 

]T        a3  i   b, 

j£S°vr-{zo} 

so  we  form  S^r  =  S^r  -  {i0}  =  {2,  3}  and  u1  =  uQ  -  1  =  1.  Since  a2  =  an  ==  min  ajt 
the  next  iteration  of  Procedure  5  finds  that 


jes^ 


H        a,  < 


so  5i._  is  a  minimal  cover,  and 


5Z     X3+  J2  Xj<"l 

j€Sl„r  j£N+-S°vr 

is  a  cut.  The  new  cut  is 

x2  +  x3  +  x4  +  x5  <  1.  (111.22) 

Since  no  lifting  can  be  performed  on  (III. 22)  and  tightening  assigns  cut  coefficients  of  1  for 
all  variables  not  in  the  cover,  (111.22)  is  a  facet  of  the  knapsack  polytope  associated  with 
(111.21). 
End  of  Example  2  (part  b) 

3.  Type  II  Non-Minimal  Cover  Cut-Finding  Problem 

Type  II  NMCCs  are  valid  inequalities  that  require  that  one  or  more  cut  coefficients 

be  greater  than  1  to  obtain  a  violated  valid  inequality.   Type  II  NMCCs  can  be  found  by 

a  three-step  process.   First,  we  solve  the  NMCC-finding  problem.   If  the  solution  to  the 

NMCC-finding  problem  indicates  that  no  Type  I  NMCC  exists,  the  NMCVI  is  lifted  and 

tightened  to  a  facet  of  the  associated  knapsack  polytope  much  as  we  did  for  Type  I  NMCCs. 

We  then  examine  the  resulting  facet-defining  valid  inequality.  If  the  facet  is  violated,  then 

we  have  found  a  Type  II  NMCC.  If  not,  we  must  first  check  the  strong  cover  S'  used  to 

find  the  facet.  If  ^   a,j  —  b  =  1,  then  we  know  that  we  have  assigned  the  maximum  cut 

jes' 
coefficient  to  each  variable  in  the  cut,  and  no  Type  II  NMCC  exists.  If  ^  a3-b  >  1,  there 

may  exist  other  facets  that  can  be  found  by  exchanging  facet  coefficients  among  variables 
in  certain  equivalence  classes.  The  equivalence  classes  are  defined  by 
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b-Ai(s-h)  <  az  <b-Ai$i(s-ti),  h  =  2,3,...,\S'\-  1.  (111.23) 

where  A  i§,  i  (s  —  h),  h  =  2,3,  ...,\S'\-l  represent  the  last  partial  sums  used  by  Procedure  4 
to  find  the  first  facet.  The  equivalence  classes  identify  sets  of  variables  that  will  have  facet 
coefficients  of  either  uj{  =  /i-lorwj  =  h.  Note  that  in  Procedure  4,  the  first  coefficient  that 
falls  in  any  equivalence  class  will  have  a  facet  coefficient  of  W{  =  h  and  cause  partial  sums 
to  be  adjusted.  If  two  variables  are  in  the  same  equivalence  class  and  have  different  facet 
coefficients,  then  the  facet  coefficients  can  be  exchanged  so  the  variable  with  the  greater  X{ 
has  the  greater  a;*. 

The  following  procedure  finds  a  Type  II  NMCC,  if  one  exists. 

PROCEDURE  7  (Type  II  Non-minimal  cover  cut-finding  algorithm):  This  algorithm 
takes  b,  the  values  of  x3  and  a3,  j  G  N+,  and  lo0,  and  returns  the  facet  coefficients  uj\  for 
Xi,i  G  S',  or  returns  the  message  that  no  Type  II  NMCC  exists. 

Input:  The  values  of  Xj  and  a3,  j  G  iV+,  the  right-hand  side  of  the  constraint  b,  and  the 
right-hand  side  of  the  cut  ujq. 

Output:  The  facet  coefficients  u)[  for  xt,  i  €  S',  or  the  message  that  no  Type  I  NMCC 
exists. 

Begin 

Lift  the  NMCVI  to  a  facet  by  using  Procedures  1  -6  as  required. 

if  Yl  %j+  J2  ^i^i  -  ^0  >  o 

jeS'         iGs' 

Return  "Facet  is  a  Type  II  NMCC,"  and  set  uj't  =  ut  for  i  e  S'. 
Else 

If  £  a3-b=l 

3€S' 

Return  "No  Type  II  NMCC  exists" 
Else 

For  each  equivalence  class  Q  =  2, 3, ...,  |5"|  -  1 
ForalU,fc  €  Q 

If  uj1  >  uik  and  Xi  <  Xk,  i,k  G  Q 

u'k  =  u>t  and  lo\  =  uik 
Else 

uj\  =  luj  for  all  i  G  Q 
Endif 
Endfor 
Endfor 
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If  ]T  Xj+  Yl  ^Xi  -  ujq  >  0 
jes'  l€s' 

Return  uj^  for  Xi,  i  e  S' 
Else 

Return  "No  Type  II  NMCC  exists' 
Endif 
Endif 
End 


Example  3:  We  have  the  knapsack  constraint 

2x1  +  2x2  +  2x3  +  2x4  +  3x5  4-  3x6  4-  3x7  4-  5x8  <  6  (111.24) 

with  positive  LP  solution  values 

X!  =  1/4,  x2  =  1/2,  x3  =  1/2.  x4  =  1,  x7  =  1/2 

and  the  NMCVI 

xi  4-  x2  +  X3  +  x4  +  x7  <  3.  (III. 25) 

Since 

~       ^       ^       ^       ^       n3 

Xi  +  X2  +  X3  +  X4  +  X7  =  2  —  , 

4 

(III. 25)  is  not  a  cut.  If  we  form  a  TMCVI  and  lift  and  tighten  it  to  a  facet,  we  obtain  the 
following  valid  inequality: 

X!  +  x2  4-  X3  +  x4  +  2x5  +  X6  +  x7  +  3xg  <  3 

but  still 

xi  +  x~2  +  X3  4-  x4  +  2x5  4-  x~6  4  x 7  4-  3x8  <  3 
because  the  only  variables  that  got  larger  coefficients  were  0  in  the  LP  solution.  We  define 
the  equivalence  classes  using  (III. 23): 

Equivalence  Class    2  <  ax  <  4     4<at<4 
Facet  coefficients     u>i  =  1  or  2    u>i  =  2  or  3. 

Since  variables  x5,  xq,  and  x7  are  all  in  the  same  equivalence  class  (note  the  second  equiv- 
alence class  is  empty),  we  find  that  lo5  >  uj7  and  x5  <  x7,  and  we  interchange  lo5  and  u7 
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so  that  uj'5  =  1  and  u>'7  =  2.  The  new  facet  is 

xi  +  x2  +  x3  +  2:4  +  x5  +  x6  +  2x7  +  3x8  <  3, 

and  since 

X 1  +  X2  +  £3  +  X4  +  x5  +  Xq  +  2x7  +  3x8  =  3-  >  3, 

4 

it  is  a  Type  II  NMCC. 
End  of  Example  3 

The  procedure  to  form  Type  II  NMCCs  requires  that  we  have  a  minimal  cover  from 
which  we  generate  a  facet.  However,  sequential  lifting  of  facets  associated  with  minimal 
covers  does  not,  in  general,  produce  all  facets  associated  with  the  polytope  P  (Balas  and 
Zemel,  1 984).  For  facets  not  associated  with  minimal  covers,  a  procedure  similar  to  our 
XVMCC  cut-finding  procedure  may  be  able  to  produce  these  facets.  This  procedure  is  left 
for  future  research. 

E.         SUMMARY 

In  this  chapter,  we  developed  new  techniques  for  finding  and  lifting  cuts  from  in- 
dividual knapsack  constraints.  We  described  an  algorithm  that  finds  a  maximally  violated 
minimal  cover  cut  for  a  knapsack  constraint  if  such  a  cut  exists,  an  algorithm  that  lifts  a 
minimal  cover  cut  to  a  lifted  minimal  cover  cut  and  we  developed  a  new  lifting  procedure 
called  "interior  lifting"  that  lifts  a  lifted  minimal  cover  cut  to  a  strong  cover  cut.  We  adapted 
polynomial-time  facet  finding  algorithms  to  tighten  strong  cover  cuts  to  violated  facets,  and 
identified  conditions  and  created  procedures  that  streamline  the  facet-finding  process. 

We  identified  a  new  type  of  knapsack  cut,  the  "non-minimal  cover  cut,"  a  cut  that 
cannot  be  found  by  solving  the  traditional  minimal  cover  separation  problem.  We  devel- 
oped non-minimal  cover  cut-finding  procedures  and  a  new  lifting  procedure  called  "deficit 
lifting"  that  creates  a  violated  extended  minimal  cover  valid  inequality  from  a  non-minimal 
cover  cut,  if  necessary.  The  complete  procedure  of  cut-finding,  lifting  and  tightening  for  ei- 
ther a  minimal  or  a  non-minimal  cover  cut  produces  a  violated  facet  in  pseudo-polynomial 
time. 
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IV        KNAPSACK  CUT  EXTENSIONS 

This  chapter  develops  two  extensions  to  the  results  of  Chapter  III  on  knapsack  cuts. 
In  particular,  we  show  how  to  generate  cuts  for  "elastic  knapsack  constraints"  (knapsack 
constraints  with  penalized  violation  allowed),  and  for  knapsack  constraints  with  senses  of 
"greater-than-or-equal-to"  and  "equality." 

A.         CUTS  FOR  ELASTIC  KNAPSACK  CONSTRAINTS 

Our  research  extends  the  basic  results  on  the  knapsack  polytope  to  include  the  gen- 
eration of  cuts  from  elastic  knapsack  constraints.  The  elastic  knapsack  constraint  is 

^2  a3xj  ~  z  <  b  (IV1) 

jeN 

where  the  a,j  and  b  are  positive  integers,  a3  <  b  V  j '<  £  N,  x3  are  binary,  and  0  <  z  <  z\  if 
z  is  not  explicitly  bounded  above,  then  implicitly  I  =  ^  a3  -  b.  The  variable  z  represents 
the  additional  units  of  resource  that  can  be  used  above  and  beyond  the  basic  limit  of  b  if  an 
appropriate  (linear)  penalty  is  paid.  We  develop  a  method  to  cut  off  fractional  solutions  to 
elastic  knapsack  constraints  that  parallels  many  of  the  knapsack  cut  procedures  developed  in 
Chapter  III.  Because  all  cuts  must  be  valid  inequalities,  we  first  examine  valid  inequalities 
for  the  elastic  knapsack  constraint. 

1.  Valid  Inequalities  for  the  Elastic  Knapsack  Polytope 

We  again  focus  on  minimal  covers,  because  we  can  extend  many  of  our  minimal 
cover  cut  results  for  standard  knapsack  constraints  to  elastic  knapsack  constraints.  When 
we  generate  "elastic  minimal  cover  valid  inequalities"  (EMCVI)  for  (IV 1),  we  note  that  if 
z  is  not  explicitly  bounded  above,  the  implicit  upper  bound  of  z  =  ]T  a3  —  b  allows  any 
integer  solution  to  be  selected  for  the  right  price.  Thus,  when  z  is  implicit,  z  must  appear 
in  every  EMCVI. 
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The  conditions  for  the  minimal  cover  are  altered  from  the  standard  MCVI  by  ;ie 
addition  of  the  variable  z.  S  given  z,  denoted  S$,  will  be  an  "elastic  minimal  cover"  for 
(IVl)if 

]T  aj  >  b  +  [?\ 

and 

Y^     *j  <  b  +  \z\  ,  V i . €  S?. 
Thus,  an  EMC VI  for  (IV 1)  is 

|>-ri^|S|-L 

Example  1  (part  a)  Consider  the  elastic  knapsack  constraint 

2x1  +  3x2  +  4x3  +  6x4  +  3x5  +  x6  -  z  <  7  (IV2) 

where  z  =  3.  Given  an  LP  solution  with  z  =  2,  an  elastic  minimal  cover  is  S?  =  {1,2,3,6}. 

The  associated  EMCVI  is 

z 
xi  +  x2  +  x3  +  X6  -  -  <  3.  (IV3) 

o 

By  rearranging  (IV3),  it  becomes  clear  that,  when  7  =z  =  3, 

z 
Xi  +  X2  +  X3  +  Xq  <  3  4-  - 

o 

is  really  enforcing 

Xi  +  X2  +  X3  +  X6   <  4, 

allowing  all  the  variables  in  the  valid  inequality  to  be  1 .  When  z  =  3,  the  rearranged  elastic 
constraint  (IV2) 

2xi  +  3x2  +  4x3  +  6x4  +  3x5  +  X6  <  7  +  z 
is  actually  enforcing 

2xi  +  3x2  +  4x3  +  6x4  +  3x5  +  xe  <  10 

which  does  allow  xi  =  X2  =  X3  =  x&  =  1.  This  verifies  that  the  EMCVI  we  developed  is 
a  "valid"  inequality,  as  it  does  not  disallow  any  valid  solutions  given  0  <  7  <  z. 
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End  example  1  (part  a) 

2.  Finding  a  Maximally  Violated  Elastic  Minimal  Cover  Cut 

We  now  develop  a  procedure  to  find  an  elastic  minimal  cover  cut  (EMCC).  A  "max- 
imally violated  elastic  minimal  cover  cut"  (XVEMCC)  for  an  elastic  knapsack  cut  may  be 
found  by  modifying  the  XVMCC-finding  procedure  found  in  Chapter  III.  Specifically,  the 
objective  function  and  constraints  must  be  modified  to  account  for  the  constraint  violation 
variable  z. 

a.  Cut-finding  problem  formulation 

In  order  to  find  an  XVEMCC,  we  must  identify  a  knapsack  constraint  of  the 
MIP  that  has  at  least  one  variable  with  a  fractional  LP  solution  value  x3 .  Once  a  suitable 
constraint  is  found,  we  solve  the  cut-finding  problem: 
Indices: 

j      £jV  =  {l,2,3,...,n}  variable  index  for  the  knapsack  constraint 
N+    =  {  j  e  N  \  £j  >  0}  where  x  is  the  solution  of  the  LP  relaxation  of  the  MIP 

Given  data: 


x j  value  for  Xj  in  a  solution  of  the  LP  relaxation  of  the  MIP 

z  value  for  z  in  a  solution  of  the  LP  relaxation  of  the  MIP 

aj  knapsack  constraint  coefficient  of  Xj 

b  right-hand  side  of  the  knapsack  constraint 


Decision  variables: 


hj     1  if  xj  is  placed  in  the  minimal  cover  inequality;  0  otherwise 

r     is  a  general  integer  variable  that  is  the  right-hand  side  of  the  XVMCC 


Formulation: 
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z*t  =    maximize       ^Z    £jhj     ~t^E    ~r 

j€N+ 

subject  to:      J2    ajflj  ^    b  +  [z\  +  1 

E    ajhj  <     6  +  [?J  +  amin 

22    ajhj         —t  =0 

E    hj  ~r    =     1 

j€N+ 

hj  e    {o,i}Vj€iv+ 

*  €     {b+lz\+l,...,b+lz}+amin} 

r     e     {0,1,2,..., |iV  +  |-l} 

(IV4) 

where  amin  =  min    a7-. 

je  n+ 

To  ensure  that  all  EMCCs  are  found,  we  actually  solve  the  cut-finding  problem  \N+\  times 
with  each  a3  =  amin,  j  €  N+  and  requiring  /ij  =  0  for  every  a,j  <  amin.  (Actually,  we 
need  to  solve  the  cut-finding  problem  only  |iV+|  —  p  times,  where  |  TV  "•"  J  —  p  is  the  number 
of  unique  a3,  j  e  N+.) 

Although  the  above  IP  is  nonlinear,  it  can  be  solved  fairly  easily,  and  an 
EMCC  has  been  found  if 

EXjh* -  r*  >  0, 
3   3       t*  -  b 
J'€52 

where  h*,  t*,  r*  solve  (IV4). 

b.  Dynamic-programming  reformulation 

We  reformulate  the  cut-finding  problem  in  order  to  solve  it  with  dynamic 
programming  as  we  did  in  Chapter  III.  Thus,  the  actual  cut-finding  problem  we  solve  is: 
xxxxx 

Ki  =  !+    max  max       £    {x3  -  l)h3     —^ 

1  h  j€N+ 

subject  to:      b'  <    ]T    ajhj  <    b" 


}fa,h]        -t    =    0  0V5) 

h3  e     {0,1}  Vj  G  N  + 
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where  b'  =  b  +  [z\  +  1  and  b"  =  b  +  [z\  +  amin.  The  problem  is  solved  at  most  \N+\  times 
with  each  unique  a,  =  amin,  j  e  N+  and  requiring  every  a3  <  amin,  j  e  N+  to  have 


/ij  =  0. 


The  reformulation  (IV5)  can  be  solved  via  a  DP  recursion 
DP  Recursion  3 

Initial  conditions: 

do(0)  =  1 

do(a')  =  —  oo  for  a'  =  1, ...,  b  +  amm 

dk{a')  —  -oo  for  all  k,  a'  <  0 

Recursion: 

•dfc(a')  =max  {dk-i(a'),dk-i(a'  -  ak)  +  {xk  -  1)} 

h 

for  fc  =  1, ...,  |A^+| ,  a'  =  0, ...,  6  +  amin. 
The  solution  to  the  problem  is 

z*el  =  1+    max    d\N+Aa) ■ -. 

b'<a'<b"    '      '  a'  —  b 

If  z*d  >  0,  where  h*  solves  (IV5),  an  XVEMCC  has  been  found,  and  the  corresponding 
elastic  minimal  cover  S?  =  {k\h*k  =  1}  can  be  recovered  through  auxiliary  data  structures 
within  the  dynamic  programming  algorithm.  The  XVEMCC  is 

Example  1  (part  b)  Suppose  the  solution  to  the  LP  relaxation  of  a  MIP  with  knapsack 
constraint 

2xi  +  3x2  +  4x3  +  6x4  +  3x5  +  xq  —  z  <  7 

is 

3  ^ 

xi  =  l,x2  =  l,x3  =  -,x4  =  0,x5  =  0,x6  =  1,?  =  2. 
4 

Recall  the  modification  to  the  cut-finding  problem  changes  the  constraint,  replacing  the 
original  b  with  b  +  |j^J  : 

2xi  +  3x2  +  4x3  +  6x4  +  3x5  +  X6  <  9. 
75 


The  cut-finding  problem  looks  for  the  most  violated  minimal  cover  cut,  with 

violation  =  V^  x*  — — |5?|  —  1. 

jh  3 

We  solve  (IV5)  and  fmd  the  EMCC 

z 
xi  +  X2  +  xt,  +  x§  —  -  <  Z 

which  is  violated,  since 


violation    =    y^xj-  -= -  (  5?  -  1) 

3       2 
=    34-3"3 

1 

12" 
End  example  1  (part  b) 

3.  Lifting  and  Tightening  Elastic  Minimal  Cover  Cuts 

Simple  lifting  can  be  conducted  just  as  with  standard  knapsack  cuts,  but  interior 
lifting  and  tightening  must  be  altered  in  order  to  ensure  that  the  cuts  remain  violated  and 
valid. 

a.  Simple  lifting 

Any  variable  with  a  constraint  coefficient  greater  than  or  equal  to  the  largest 
constraint  coefficient  of  the  variables  in  the  minimal  cover  S  can  be  lifted. 
Example  1  (part  c)  Recall  the  EMCC  from  part  b: 

z 
xi  +  x2  +  x3  +  x6  -  -  <  3. 
o 

Because  a4  >  a?  =max  a,,  the  variable  x4  is  lifted,  creating  the  lifted  EMCC 

Z 
X\  +  X2  +  Xs  +  X4  +  Xq  -  -  <  6. 

o 
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End  example  1  (part  c) 

b.  Interior  lifting 

As  with  standard  knapsack  valid  inequalities,  it  is  theoretically  possible  to 
lift  an  EMCC  to  an  elastic  strong  cover  cut.  However,  once  interior  lifting  is  completed,  the 
coefficient  of  the  variable  z  in  the  EMCC  must  be  recomputed  using  the  coefficients  of  the 
variables  in  the  strong  cover  S~-  Since  the  cover  is  now  strong,  ^   aj  <  Yl   aj  >  an<^  the 

coefficient  of  z,    y  \  _b,  is  now  larger.  Because  the  z  term  is  subtracted  when  calculating 

the  amount  of  violation, 

violation  =  £»,-   E  * f 

the  adjustment  of  the  coefficient  can  cause  the  EMCC  to  "lose"  its  violation.  Therefore,  in 

practice,  we  do  not  use  interior  lifting  on  EMCCs  that  have  z  >  0. 

Example  2  (part  a)  Suppose  the  solution  to  the  LP  relaxation  of  a  MIP  with  elastic  knapsack 

constraint 

20xi  +  25x2  +  25x3  +  45x4  +  21x5  -  z  <  50 

is 

5  ^8 

xi  =  1,  x2  =  1,  x3  =  -,  x4  =  0,  x5  =  0,  z  =  8-. 

The  knapsack  constraint  contains  two  fractional  variables.   The  solution  to  (IV5)  is  the 

EMCC  with  5?=  {1,2,3}  : 

2 

xi  +x2  +  x3  -  —  <  2 


which  is  a  cut  because 


^       ^       ~        z 

xi  +  x2  +  x3  -  —  >  2. 


Simple  lifting  extends  the  EMCC  to 

z 
xi  +  x2  +  x3  +  x4  -  —  <  2, 

which  is  still  violated  since  x4  =  0.  Next,  interior  lifting  allows  us  to  include  the  last 
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variable  and  create  an  elastic  strong  cover  valid  inequality.  However,  we  must  recompute 
the  coefficient  of  z.  When  we  do  that,  the  valid  inequality 


is  not  a  cut  because 


End  example  2  (part  a) 


z 

X\  +  X2  +  Xs  +  X4  +  x5 <  2 

16 


^.        ^        ^        ^        ^         z 
xi  +  x2  +  x3  +  x4  +  x5  -  —  =  2. 

16 


c.  Facets  of  the  elastic  knapsack  polytope 

Once  we  have  found  an  EMCC,  we  would  like  to  form  a  facet  of  the  elas- 
tic knapsack  polytope.  The  variable  z  complicates  matters,  as  we  have  already  experienced 
with  interior  lifting.  Since  we  cannot  blindly  apply  the  results  from  Chapter  III,  we  must 
carefully  identify  under  which  conditions  we  can  create  a  facet  of  the  elastic  knapsack  poly- 
tope. 

When  the  elastic  minimal  cover  Sj  is  strong,  and  z  =  J^  a3 ■.  —  b,  we  can  lift 

jeN 
the  elastic  strong  cover  cut  to  a  facet  of  the  elastic  knapsack  polytope.  The  conditions  that 

identify  if  a  cover  5?  is  strong  are 

E(SS)  =  N,  (IV6) 

or,  if  there  are  no  variables  that  could  be  lifted  (with  a  coefficient  of  1 )  through  interior 

lifting,  that  is,  if 

]T        a.j  +  a{  <  b  +  [zj  ,  Vt  €  N  -  E{S2),  (IV7) 

where  jmax  =argmax  a3.  If  either  condition  (IV6)  or  condition  (IV7)  is  met,  then  we 
redesignate  5j  as  the  elastic  strong  cover  S~,  and 

E  x>+      E      x>  -  y  l_b  *  1^1  "  1 

is  a  facet  of  the  elastic  knapsack  polytope. 

Theorem  4.1     If  the  elastic  minimal  cover  S'~  is  strong,  then  the  elastic  strong  cover  valid 

78 


inequality 


E 


Xj  + 


J2    xj- 


<  i^i  - 1, 


ieSL 


j£E(S'~)-S: 


3€SL 

where  z  =J2  a,3  -  b  and  a3  <  6  V  j  €  N,  is  a  facet  of  the  elastic  knapsack  polytope 


(IV8) 


PE  =  conv  \  x  €  {0,  l}n  ,  0  <  z  <  z  \^2  *jZj  -  z  <b\ 

I  j£N  J 


(IV9) 


Proof.  The  valid  inequality  (IV8)  is  a  facet  of  the  elastic  knapsack  polytope  if  it  is  satisfied 
by  every  x  G  Pe,  and  satisfied  at  equality  by  exactly  d  affinely  independent  points  x  £  PE, 
where  d  =  n  +  1  is  the  dimension  of  PE-  Consider  the  elastic  constraint 


y     djXj  —  z  <  6, 

j<=N 


(IV 10) 


where  a3  <  b  V  j  e  N,  a\  +  a^  >  b  +  z,  n  =  \N\  and  z  is  not  explicitly  bounded. 

Since  S~  is  strong,  a  strong  elastic  minimal  cover  valid  inequality  for  (IV 10) 
is 


E 


Xj  + 


51    x^- 


j€5i  j6£(Si)-5: 


where  2  =  ^  a3  —  b. 


T,   aj  ~b 


<  \S's\  -  1, 


(IV11) 


Xi 

1 

0 

1 

1 

1 

1 

1 

x2 

0 

1 

1 

1 

1     • 

1 

1 

z 

0 

0 

E2 

£3 

£4  • 

En-1 

En 

X$ 

0 

0 

0 

1 

0 

0 

0 

X4 

0 

0 

0 

0 

1 

0 

0 

Xn—1 

0 

0 

0 

0 

0     • 

1 

0 

Xn 

0 

0 

0 

0 

0      • 

0 

1 

Table  1.  This  table  contains  the  n  linearly  independent  points  that  demonstrate  the  elastic  strong  cover  valid  inequality 
(where  \S~\  =  2)  is  a  facet  of  the  elastic  knapsack  polytope  for  the  strong  cover  Sj  when  E{S~)  =  N.  £2  =  ai  +  0-2  -  b 
and  E*c  =  a\  +02  +  a-h  —  b,  k  =  3,4,  ...,n. 

In  Table  1  there  are  n  linearly  independent  points  that  satisfy  (IV11)  at  equal- 
ity, and  since  linear  independence  implies  affine  independence,  the  dimension  of  (IV11)  is 
at  least  n.  Since  the  dimension  of  the  elastic  polytope  PE  is  n  +  1,  (IV11)  is  a  facet  of  PE. 
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The  result  for  \S~\  =  k,  k  >  2  follows  by  induction  on  k. 

Note:  We  can  easily  form  \N  —  E(S~)\  other  linearly  independent  points  for 
the  case  E(S~)  <  N  to  verify  that  the  facet  has  appropriate  dimension  when  variables  are 
implicitly  assigned  a  facet  coefficient  of  0  by  their  exclusion  from  the  inequality.  QED 


When  we  have  an  EMCC  and  z  >  0,  we  must  forego  interior  lifting.  Thus, 
if  Ss  is  not  strong,  we  will  not  create  a  strong  cover  from  the  elastic  minimal  cover,  and  the 
(possibly  lifted)  EMCC  may  not  be  a  facet.  This  next  example  shows  why  this  is  true. 
Example  3  Suppose  the  solution  to  the  LP  relaxation  of  a  MIP  with  elastic  knapsack  con- 
straint (with  z  not  explicitly  bounded) 

20xi  +  25x2  +  21x3  -  z  <  40 

is 

-        i    -        21    -        n  ~      i 

X!  =  1,X2  =   —  ,X3  =  0,2  =   1. 

lb 
The  knapsack  constraint  contains  one  fractional  variable.  The  solution  to  (IV5)  is  the  EMCC 

withS?=  {1,2}  : 


which  is  a  cut  because 


xi+x2-Z-<\  (IV12) 

5 


^       ~        z 

Xi  +  xo >  1. 

5 


When  we  include  x3  by  interior  lifting, 


is  not  a  cut  because 


z 
Xj  +  x2  +  x3  -  -  <  1 


^        ~        ~         z 

Xi  +  x2  +  x3  -  -  <  1. 


So,  we  must  use  (IV 12)  as  a  cut.  But,  is  it  a  facet  of  the  elastic  polytope?  Recall  that  a 
facet  of  the  integer  polytope  PE  (IV9)  is  an  inequality  that  is  satisfied  by  every  x  €  Pe, 
and  satisfied  at  equality  by  exactly  d  affinely  independent  points  x.  e  Pe,  where  d  is  the 
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dimension  of  PE.  We  examine  the  points  that  satisfy  (IV 12)  at  equality  in  this  table: 


X 

ePE 

x<£PE 

Xi 

z 

1 

0 
0 

0     1 

1    1 

0     5 

1     0     1 
0     1     1 
0     0     5 

*3 

0 

0     0 

1     1     1 

Note  the  points  that  satisfy  (IV 12)  at  equality,  but  are  not  in  the  polytope  PE.  Since  we 
only  have  3  points  x  e  Pe  that  satisfy  (IV 12)  at  equality,  and  the  dimension  of  PE  is  4,  we 
cannot  possibly  have  four  afFinely  independent  points  that  satisfy  (IV 12),  so  (IV 12)  cannot 
be  a  facet. 
End  example  3 


d.  Tightening 

In  the  previous  section,  we  developed  a  procedure  to  generate  strong  cuts 
and  facets  for  elastic  knapsack  constraints  with  an  implicit  upper  bound  I  =  ^  a3  —  b  on 
the  constraint  violation  variable  z.  When  z  <  ^  a-j  —  b,  the  elastic  knapsack  constraint  will 
not  allow  all  variables  to  be  set  to  1  at  the  same  time,  and  some  of  the  variables  lifted  into 
the  EMCC  may  require  coefficients  greater  than  one.  We  can  use  the  tightening  Procedures 
3  or  4  from  Chapter  III  by  deriving  the  appropriate  coefficients  uo3  for  variables  Xj  as  if  they 
belonged  to  the  knapsack  constraint 

>     djXj  <  b  +  z. 
To  use  Procedure  3,  the  elastic  cover  must  be  tight,  that  is 

y~]  aj  =  b + z + 1. 

If  the  elastic  cover  is  not  tight,  Procedure  4  must  be  used.  To  use  either  procedure,  substitute 
b  +  z  for  6.  The  EMCC  is  then  tightened  to 


jZSL  j£E{SL)-SL 


E  aj  - b 


<  141  "  1, 
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which  is  a  strong  cut  (perhaps  a  facet)  for  the  elastic  knapsack  polytope. 

We  can  also  use  these  tightening  procedures  when  S?  is  not  strong  by  ignor- 
ing any  variables  xiti  e  N  -  E(S^)  that  do  not  meet  condition  (IV7).  But,  in  this  case,  we 
know  that  we  will  not  form  a  facet. 
Example  2  (part  b)  Given  the  knapsack  constraint 

20xi  +  25x2  +  25x3  +  45x4  +  21x5  -  z  <  50, 

and  z  =  10,  we  tighten  the  cut  formed  in  Example  2,  part  a, 

z 
xi  +  x2  +  x3  +  x4  -  —  <  2, 

by  rewriting  the  constraint  with  the  substitution  b  +  z  for  b  : 

20xi  +  25x2  +  25x3  +  45x4  +  21x5  <  50  +  z  =  60. 

Since  Yl  a-j  >  b  +  z  +  l,v/euse  the  Procedure  4  lifting  process  in  Chapter  III.  Thus,  we 
assign  u>4  =  2,  and  the  new  valid  inequality  is 

z 
xi  +  x2  +  x3  +  2x4  -  —  <  2. 

End  example  2  (part  b) 

Note  that  we  ignored  the  variable  x5,  the  variable  that,  through  interior  lift- 
ing, removed  the  violation.  Our  lifting  process  is  still  valid,  but  we  forego  the  possibility 
of  finding  a  facet  of  the  elastic  knapsack  polytope. 

4.  Non-Standard  Elastic  Knapsack  Constraints 

We  consider  a  variant  of  (IV 1)  where  one  or  more  a3  >  b,  j  €  N.  When  an  elastic 
minimal  cover  is  found  with  one  of  the  variables  having  such  a  constraint  coefficient,  the 
valid  inequality  (and  cut)  derived  is  altered.  Define 

S?  =  0>j  >b,j  €5?}, 
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and  let  af  .    =min  a,.  For  any  elastic  minimal  cover  containing  such  a  variable,  the  valid 

./mm  j&s> 

inequality  is 

J2  Xj+       J2       uix*  ~  a>  Z _b  £  \S'z\  ~  !. 

where  the  coefficient  of  z  has  changed  from    y  ^  _b  to  a>1  _b-  The  cut-fmding  problem 

must  be  amended  to  reflect  this  coefficient  change  as  well. 
We  also  can  derive  cuts  for  another  elastic  constraint, 

>     djXj  +  z  >  b. 

After  a  simple  conversion,  discussed  in  the  next  section,  the  constraint  becomes  of  form 
(IV 1),  and  all  procedures  in  this  section  can  be  applied. 


B.         KNAPSACK  CONSTRAINTS  WITH  NON-STANDARD  SENSES 

All  our  results  thus  far  have  been  for  the  knapsack  polytope  associated  with  the 
"standard"  form 

Y^  ajXj  <  b.  (IV13) 

Our  results  are  easily  adapted  for  knapsack  constraints 

]T  cijXj  >  b  (IV 14) 

and 

y     cijXj  =  b 

where  a3  and  b  are  positive  integers,  Xj  are  binary  variables,  and  N  —  {l,...,n}. 

1.  Greater-Than-Or-Equal-To  Knapsack  Constraints 

We  use  our  existing  algorithms  by  simply  converting  (IV14)  to  the  form  of  (IV13). 
This  is  accomplished  by  replacing  the  variable  Xj  with  its  complement  (1  -  y3).  (Crowder, 
et  al.  (1983)  substitute  complementing  variables  to  convert  less-than-or-equal-to  knapsack 
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constraints  with  one  or  more  negative  coefficients  a,j  to  (IV 13).)  Thus,  by  the  substitution 
in  (I VI 4),  we  have 

jeN 
the  new  standard  knapsack  constraint  is 

£«W  <£«*-*  (IV15) 

jeN  jgn 

where  a .,  and  £]  %-  —  6  are  positive  integers,the  j/j  are  binary  variables,  and  JV  =  { 1, . . . ,  n} . 
Once  (IV 15)  is  formed,  we  find  the  complementary  LP  solution  values  y?  =  1  —  xj. 
We  then  apply  one  of  the  cut-finding  problems  and,  if  an  XVMCC  or  an  NMCC  exists,  all 
lifting  and  tightening  procedures  are  applied  and  we  find  a  facet 

Yl  yi+  ]C  WjyJ  -  I5''  ~  L 

We  now  transform  the  facet  back  into  the  original  variable  space  before  appending  it  to  the 
MIP  The  facet  added  to  the  MIP  is 

]T  Xj+  Y^  UjXj  >Y  UJ  +  L 

jeS'         j£s'  jes' 

Example  4  Suppose  the  solution  to  the  LP  relaxation  of  a  MIP  with  knapsack  constraint 

4xi  +  4x2  +  2x3  +  2x4  +  5x5  +  3x6  +  9x7  +  3xg  +  8x9  >  30 

is 

^3_  ^  „  ^4^ 

X\  —  -,  x2  =  0,  X3  =  0,  X4  =  0,  X5  =  -,  X6  =  1,  X7  =  1,  Xg  =  1,  Xg  =  1. 

4  5 

The  knapsack  constraint  has  two  fractional  variables.  The  transformed  knapsack  constraint 

4yi  +  4y2  +  2y3  +  2^4  +  5y5  +  3y6  +  9y7  +  3y8  +  8y9  <  10 
has  a  transformed  LP  solution  of 

Vl  =  7i  V2  =  !>  2/3  =  1,  2?4  =  1,  2/5  =  ~,  Vj ■  =  0  V  J >  5 
4  5 
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The  solution  to  the  XVMCC-finding  problem  is  an  XVMCC  with  minimal  cover  S  = 
{1,2,3,4} 

V\  +  V2  +  Vz  +  Va  <  3. 
Applying  Procedures  1 ,  2  and  3  yield  the  facet 

V\  +  V2  +  V3  +  V4  +  2/5  +  2/6  +  3y7  +  2y9  <  3. 
Transforming  back  to  the  original  variable  space  yields  the  facet 

x\  +  X2  +  £3  +  £4  +  £5  -f  x$  +  3x7  +  2x9  >  8 

which  is  now  appended  to  the  MIP  to  cut  off  x. 
End  example  4 

2.  Equality  Knapsack  Constraints 

We  can  use  our  existing  algorithms  for  knapsack  constraints  with  equality  senses, 
also.  First,  we  convert 

y  a,jXj  =  b 

to 


Y^  0-1*3   <  h  (IV16) 


and 


^TajXj^b.  (IV17) 


JGN 

Then  we  convert  (IV 1 7)  by  complementing,  and  apply  all  applicable  procedures  from  Chap- 
ter III  to  both  constraints  that  are  now  of  the  form  (IV 16). 
Example  5  Suppose  the  solution  to  the  LP  relaxation  of  a  MIP  with  knapsack  constraint 

2xi  +  2x2  +  3x3  +  4x4  =  5 


is 

xi  =  l,x2  =  l,x3  =  -,£4  =  0. 
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We  can  represent  the  constraint  by 

2xi  +  2x2  +  3x3  +  4x4  <  5  (IV18) 

and 

2*1  +  2x2  +  3x3  +  4x4  >  5.  (IV 19) 

The  lifted  and  tightened  minimal  cover  cut  for  (IV 18)  is 

Xi  +  X2  +  X3  +  2x4  <  2. 

We  transform  (IV 1 9)  by  complementing,  which  yields 

2t/i  +  2y2  +  32/3  +  4y4  <  6,  (IV20) 

with  a  transformed  LP  solution  of 

2  _ 

Vl  =0,2/2  =  0,2/3  =  3' 2/4=  1- 

A  minimal  cover  cut  for  (IV20)  is 

2/3  +  y4  <  1. 
Transforming  back  to  the  original  variable  space  yields  the  cut 

2:3  +  x4  >  1. 

Both  cuts  are  now  appended  to  the  MIP  to  cut  offx. 
End  example  5 
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V        EXPLICIT-CONSTRAINT  BRANCHING 

In  this  chapter  we  develop  the  new  technique  of  "explicit-constraint  branching" 
(ECB)  to  improve  the  branch-and-bound  portion  of  composite  enumeration.  Special  Or- 
dered Sets  and  Foster  and  Ryan's  branching  technique  for  overlapping  set-partitioning  con- 
straints (Foster  and  Ryan,  1981)  demonstrate  how  constraint  branching  can  improve  the  so- 
lution process  for  MIPs,  but  these  implicit-constraint-branching  techniques  require  a  special 
problem  structure.  ECB  adds  structure  to  a  MIP  by  adding  new  constraints  and  new  inte- 
ger variables  and  does  not  require  any  special  relationships  within  the  problem  structure. 
Like  implicit-constraint  branching,  the  goal  of  ECB  is  to  moderate  the  branching  process 
by  more  "evenly"  partitioning  the  feasible  region  of  the  LP  relaxation  of  the  MIP  The  value 
of  this  simple  technique  is  demonstrated  by  empirical  evidence  presented  in  Chapter  VI. 

A.         INTRODUCTION 

ECB  adds  one  or  more  constraints  of  the  form 

^  a>jXj  -  Vi  =  0  (VI) 

to  a  MIP  where  J  is  the  set  of  indices  of  integer  variables  of  the  MIFJ  a3  are  integer  constants, 
Ji  C  J,  and  the  yt  are  general  integer  "branching"  variables.  For  reasons  discussed  later, 
we  assume  a3  =  1  for  all  j  6  Jx  in  the  following  discussion. 

Each  ECB  constraint  is  created  (with  a3 ■  =  1  V  j  e  Jx)  to  allow  the  branch-and- 
bound  process  to  branch  on  a  sum  of  integer  variables  before  branching  on  any  individual 
integer  variable  in  the  sum;  intuitively  the  sum  should  be  integer  before  all  of  the  individual 
variables  in  the  sum  need  be  integer.  We  implement  this  by  setting  the  "branching  priority" 
higher  for  the  branching  variable  yl  than  the  x3  in  the  branch-and-bound  algorithm.  (Modern 
integer-programming  solvers  usually  allow  this  branch-and-bound  option.)  Then,  whenever 
branch  and  bound  sees  an  intermediate  solution  with  some  non-integer  yt,  branching  derives 
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the  two  restrictions  for  the  MIP  at  the  current  node 

Vi  <  [yi\  or  yi  >  [yi\  +  1. 

Branch  and  bound  will  only  derive  restrictions  from  a  fractional  Xj  when  all  yz  are  integer, 
continuing  to  do  so  unless  some  yi  becomes  non-integer  again. 

The  following  series  of  examples  demonstrate  how  ECB  might  be  applied.  First, 
we  repeat  the  example  of  Chapter  I  to  illustrate  ECB  where  only  a  single  ECB  constraint  is 
added,  and  to  illustrate  the  potential  effectiveness  of  the  technique. 
Example  1.  Recall  the  binary  IP  of  Example  2,  Section  1.3: 


maximize 

E  X3 

subject  to: 

£  2xj-'<    2    ^   :  +  T 

J£J                             L       J 

xj    €    {0,1}  Vj  eJ 

Variable-based  branch  and  bound  forms  a  partition  based  on  the  one  fractional  variable, 
which  we  designate  as  Xjf ,  and  derives  the  restrictions 


Xj.  <  0  or  xJf  >  1. 


\J\ 


The  process  of  fixing  variables  and  fathoming  nodes  continues  until  all  ( ,  \j[  , )  alternate 

L  2  J 

optimal  solutions  are  found  and  the  first  is  declared  optimal. 

We  reduce  the  amount  of  nodes  branch  and  bound  must  enumerate  by  adding  an 
ECB  constraint  and  creating  the  problem 


maximize 

E  X3 

J£J 

subject  to: 

E2^ 

<    2 

i 

+  1 

J€J 

-  "  J 

E  xj 

-y 

=    0 

3&J 

Xj 

e    {o,i}Vjgj 

y 

e    {0 

,i, 

2,-..,|J|} 

The  variable-based  branch-and-bound  partition  based  on  y  derives  the  restrictions 


y< 


\J\ 


ory  > 


\J\ 


+  1, 
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and  branch  and  bound  evaluates  only  three  LPs  before  the  problem  is  solved.  Thus,  by 
branching  on  the  sum  of  integer  variables,  we  solved  the  IP  without  fixing  any  binary  vari- 
ables. 
End  Example  1 

Another  example  demonstrates  how  a  single  ECB  constraint  might  be  used  with  set- 
packing,  set-covering,  and  set-partitioning  problems,  and  hybrid  versions  of  these  problems. 
Example  2. 
part  (a).  Consider  an  IP, 

minimize       ^  CjXj 

3€J 

subject  to:     Yl  aijxj    >    1  Vi  =  l,...,m 

Xj    €     {0,  l},j'G  J, 

where  the  atj  €  {0,1},  constraints  with  a  sense  of  <  are  set-packing  constraints,  constraints 
with  a  sense  of  >  are  set-covering  constraints,  and  constraints  with  a  sense  of  =  are  set- 
partitioning  constraints.  An  obvious  requirement  for  any  solution  of  this  class  of  problems 
is  that  the  sum  of  all  binary  variables  be  integer.  This  requirement  can  be  satisfied  in  a 
branch-and-bound  algorithm  (before  requiring  all  binary  variables  to  be  integer)  by  adding 
the  construct 

}]  Xj  -  y  =  0, 

jeJ 

where  y  >  0,  and  integer.  Again,  the  branching  priority  is  set  higher  for  y  than  for  the  Xj. 
part  (b). 

A  specific  example  demonstrates  how  one  ECB  constraint  can  reduce  the  work  of 
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the  branch-and-bound  algorithm  in  a  set-packing  IP  Consider  the  set-packing  IP: 

K 

maximize     ^  (xfci     +xk2    +xk3) 
fc=i 

K 

subject  to:     £  (xkl  +xk3)    <    1 

fc=i 

K 
J2   {Xki      +xk2  )      <      1 

fc=l 

E  (        ;rfc2  +***)  <   i 
fc=i 

£**,      %k2,        xfc3,    €     {0, 1}  ,  A;  =  1, ...,  K. 

This  problem  consists  of  a  set  of  K  "odd  cycles"  of  length  three  (e.g.,  Hoffman  and  Padberg, 
1 993).  Without  loss  of  generality,  we  may  assume  that  an  optimal  LP  extreme  point  solution 
will  be  of  the  form 

'■■•■[' \ .  i ,      -  '  • 

XU   —  xl2  =  xl3  =  ^>    xkx  —  xk2  —  xk3  =  0  V  k  >   1. 

It  is  relatively  straightforward  to  see  that  the  best-case  branch-and-bound  scenario  must 
solve  approximately  K  LPs,  and  the  worst-case  scenario  must  solve  approximately  3K 
LPs  before  a  declared  optimal  solution  is  found. 
By  adding  an  ECB  constraint 

K 

22  (xki  +  xk2  +  xk3)  ~  V  =  0 

fc=l 
and  branching  on  y  first,  our  initial  separation  will  be 

K  K 

yj  {xkl  +  xk2  +  xk3)  <  1  or  22  (xki  +  xk2  +  Xk3)  >  2. 
fc=i  fe=i 

The  LP  resulting  from  the  second  constraint  is  infeasible,  and  the  LP  resulting  from  the  first 

constraint  finds  a  declared  optimal  solution  to  the  problem,  since  all  feasible  LP  extreme 

points  have  some  xki  —  1,  and  all  the  other  variables  0. 

Larger  problems  with  sets  of  these  constraints  embedded  in  the  constraint  set  can  be 

handled  with  cuts  of  the  form 

xkl  +  xk2  +  xk3  <  1  V  k  =  1, ...,  K 
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but  this  entails  first  searching  for  and  finding  all  sets  of  odd  cycles.  ECB  deals  with  this 

issue  without  such  overhead. 

End  Example  2 

Example  3  Consider  an  IP  for  a  capacitated  plant  location  problem: 


minimize 
subject  to: 

i=lj=l 

n 

L^i  Xij 

i=l 

+ 

2  fczi 
i=i 

=z 

l 

Vj 

m 

2_j  VjXij 
3=1 

KiZi 

n 

E  zi 
i=l 

< 

0 
k 

Vz 

Xij 
X{j 

Zi 
Zi 

< 

e 
e 

0 

(0, 

(0, 

1} 
1} 

V  i ,  V  j 
Vz,Vj 
\/  i 

where  Dj  is  the  demand  associated  with  customer  j  and  Kt  is  the  capacity  of  the  plant 
located  at  i.  If  Zi  =  1,  then  a  plant  is  located  at  i,  and  if  x^  =  1,  then  customer  j's  demand 
is  satisfied  by  the  plant  located  at  i. 

Before  we  form  any  ECB  constraints,  we  set  the  branching  priority  higher  for  the 
plant  location  variables  zr  than  the  branching  priority  for  the  customer  variables  x{j.  This 
ensures  that  branch  and  bound  decides  which  plants  are  opened  before  deciding  which  indi- 
vidual customers  will  be  served  by  a  plant.  (This  is  equivalent  to  the  "propagation  branch- 
ing" described  by  Guignard  and  Spielberg  (1977).)  We  also  add  the  ECB  constraints 

m 

/J  ^ij  ~  Vi  =  0  V  i. 
j=l 

to  ensure  that  the  sum  of  the  customers  for  each  opened  plant  is  integer  before  branching 
on  any  individual  customer.  Branching  priorities  pw  for  variable  w  are  set  as  follows:  pZi  > 
Vyx  >  Pin*  where  the  largest  priority  is  branched  on  first. 
End  Example  4 

In  similar  problems  where  the  number  of  facilities,  such  as  plants,  warehouses,  or 
distribution  centers  is  not  fixed  but  is  perhaps  bounded  (Geofifrion  and  Graves,  1974),  it 
makes  sense  to  add  an  ECB  constraint  to  ensure  that  the  number  of  facilities  opened  is  in- 
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teger  before  branching  on  sums  of  customers.  In  our  plant  location  example,  if  we  replaced 
the  requirement  to  open  k  plants  with  an  upper  bound  of  k  instead,  we  could  add  the  ECB 
constraint 

n 

^  Zj  -  y  =  0 
where  y  e  {0, 1,2, ...,&},  and  assign  branching  priorities  py  >  p2i  >  pVi  >  px... 


B.         GENERAL  EXPLICIT-CONSTRAINT  BRANCHING 

We  define  two  different  variants  of  ECB.  "Basic  ECB"  allows  a  variable  to  appear 
at  most  once  in  an  ECB  constraint.  The  added  constraints  are 

£  *i  "  Vi  =  0,  (V2) 

where  the  J*  are  all  disjoint  subsets  of  J;  the  yi  are  assigned  higher  branching  priorities  than 
the  Xj. 

"Nested  ECB"  uses  the  subsets  of  the  variables  from  basic  ECB  constraints  to  add 
constraints  of  the  form 

22  xj  -  y**  =  0,  *  =  1, 2, ...,  m, 

j£Jik 

where  Jik  c  Jx,  and  all  Jlk  are  disjoint.  In  this  case,  the  yt  are  assigned  higher  branch- 
ing priorities  than  the  ylk ,  which  in  turn  are  assigned  higher  priorities  than  the  xj  .  We  can 
recursively  form  more  nested  constraints  from  each  previously  formed  nested  constraint 
(Jik  C  Jik,  q  —  1, 2, ...,  Q),  so  that  we  have  multiple  "levels"  of  nesting,  and  thus  multiple 
levels  of  branching  variables  where  the  priorities  are  commensurately  assigned. 

Nested  constraint  branching  could  also  be  implemented  using  a  "bottom  up"  ap- 
proach. Let  J i  u  J2  U  ...  U  Jm  =  J  define  a  partition  of  J,  and  create  the  bottom  level  of 
ECB  constraints 

/]  Xj  -  yk  =  0,  k  —  1,  2, ...,  m. 
jeJk 
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Then,  form  the  next  two  levels 

k€Ke 

^y't-  y'p  =  °' 

eeLp 
and  so  on.  Branching  priorities  would  be  determined  so  that  px    <  pyk  <  py<  <  py//,  etc. 

This  bottom-up  approach  to  nested  ECB  is  not  implemented  in  this  dissertation. 

C.  CONSTRAINT-BRANCHING  PROCEDURES 

We  distinguish  between  different  applications  of  branching  techniques.  A  static  pro- 
cedure adds  branching  constraints  before  the  MIP  solution  procedure  has  begun.  In  practice, 
we  decide  the  number  and  composition  of  ECB  constraints  to  add  for  a  static  procedure  by 
examining  of  the  constraint  set  of  the  MIR  A  dynamic  procedure  adds  branching  constraints 
during  the  branch-and-bound  process,  using  information  gleaned  from  solutions  of  LP  re- 
laxations at  nodes  of  the  enumeration  tree.  This  procedure  is  similar  to  the  cutting-plane 
procedure  called  "branch  and  cut."  One  such  dynamic  procedure  has  been  used  by  Jorn- 
sten  and  Varbrand  (1991)  to  solve  generalized  assignment  problems.  These  authors  refer  to 
the  technique  as  "generalized  branching"  and  credit  Jornsten  and  Larsson  (1988).  Implicit- 
constraint  branching  is  another  dynamic  procedure  that  uses  solution  information  from  the 
LP  relaxations  in  the  branch  and  bound  to  partition  the  set  of  variables.  We  have  developed 
"semi-dynamic  ECB"  that  uses  LP  solution  information  to  determine  the  composition  of 
the  added  ECB  constraints.  We  explain  semi-dynamic  ECB  in  the  context  of  nested  ECB 
in  Section  D.  We  consider  only  static  and  semi-dynamic  procedures  in  this  dissertation. 

D.  APPLICATIONS 

1.  Basic  ECB 

Problem  structure  will  often  dictate  how  basic  static  ECB  constraints  should  be 
added.    For  instance,  in  the  generalized  assignment  problem  (GAP),  defined  in  Chapter 
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II,  there  are  knapsack  constraints 

/     hotxot  <   Ht, 
oeot 

xot  €  {0, 1},  for  each  truck  t.  It  is  intuitively  appealing  to  enforce  the  requirement  that 

"the  sum  of  order  variables  on  a  truck  must  be  a  general  integer"  before  enforcing  the 

requirement  that  "each  order  variable  on  a  truck  must  be  binary."  Furthermore,  there  are 

many  fewer  of  the  former  requirements  to  satisfy  (typically,  \T\  <  <E  \Ot\),  and  satisfying 

t 
them  first  may  achieve  satisfaction  of  the  latter  requirements  with  little  or  no  additional 

work.  This  enables  us  to  solve,  or  nearly  solve,  the  GAP  by  branching  a  modest  number  of 

times  on  a  small  number  of  general  integer  variables  rather  than  branching  many  times  on 

a  large  number  of  binary  variables. 

We  implement  basic  ECB  by  adding  the  following  constraints  to  the  GAP: 

y^  xot  -  yt  =  0  V  t  e  T, 
oeot 

where  the  yt  are  general  integer  variables.  This  modified  GAP  has  \T\  new  constraints  that 
must  be  satisfied  and  \T\  new  integer  variables  that  must  be  solved  for.  We  hope  that  the 
additional  burden  placed  on  the  LP  solver  embedded  in  the  branch-and-bound  algorithm, 
(LP  solvers  operate,  on  average,  in  polynomial  time),  is  outweighed  by  the  potentially  ex- 
ponential reduction  in  the  number  of  LPs  that  must  be  solved. 
We  could  form  the  ECB  constraints 

J2  hotXot  -J/(  =  0ViGT,  (V3) 

oeOt 

which  correspond  to  our  original  definition  (VI),  and  treat  yt  as  a  general  integer  branching 
variable,  but  at  any  node,  the  two  restrictions 

yt  <  [yt\  or  yt  >  [yt\  +  1 
may  be  imprecise,  that  is  there  may  not  exist  any  set  0\  C  Ot  such  that  ^   hot  =  [yt\  or 

oGO't 

E  ^  =  [yt\  +  1. 
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To  efficiently  branch  with  an  ECB  constraint  of  the  form  (V3)  entails  finding  the 
feasible  values  of  yt  :  y'tl,y't2,y't3,  -,y'tm,  perhaps  by  dynamic  programming,  and  enforce 
branchings  so  that  if 

y'tk  <  yt<y'tk+1, 

then  the  branching  rule  will  be 

yt  <  y'tk  or  yt  >  y'tk+i , 

where  possibly  y'tk+i  -y'tk^l.lt  is  possible  to  branch  on  yt  where  the  values  y'tl ,  y't2 ,  y't3 , . . . ,  y[r 
are  specified  by  a  sequence  with  some  solvers  (e.g.,  the  XA  Solver,  {GAMS-The  Solver  Man- 
ual, 1993)),  but  we  are  not  guaranteed  that  the  feasible  values  of  yt  will  correspond  to  any 
given  sequence.  We  will  not  pursue  this  constraint  branching  technique  in  this  dissertation. 

2.  Nested  ECB 

When  using  nested  ECB,  it  is  important  to  remember  that  our  goal  is  to  reduce  the 
amount  of  work  the  variable  branch-and-bound  process  must  do.  If  we  add  too  many  ECB 
constraints,  we  can  easily  defeat  this  purpose.  For  example,  we  could  add  an  ECB  constraint 
(V2)  and  then  split  Jt  into  two  disjoint  subsets  Jlm  and  Jln  and  add  constraints  for  them.  If 
we  recursively  continue  this  process  until  we  eventually  form  ECB  constraints  containing 
a  single  binary  variable,  then  we  have  added  many  more  general  integer  variables  than  the 
number  of  binary  variables  that  we  began  with,  which  will  likely  be  counterproductive.  In 
practice,  we  have  discovered  that  adding  only  a  few  nested  ECB  constraints  for  each  basic 
constraint  works  well.  The  decision  of  the  number  of  ECB  constraints  to  add  and  their 
composition  depends  on  the  procedure  that  is  used. 

a.  Static  ECB 

For  static  nested  ECB,  we  use  the  number  of  variables  Xj  in  the  basic  ECB 
constraint  to  determine  the  number  of  nested  constraints  to  add  to  a  problem.  In  general,  for 
each  set  of  variables  J*  C  J,  (where  J  is  the  set  of  variables  in  the  problem),  the  technique 
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adds  an  ECB  constraint 

Y2  xj  -  v*  =  °.  cw) 

where  yt  is  a  general  integer  variable,  and  then  adds  constraints 

^y  £j  -  Vik  =  0,  fc  €  #, 

n 

where  if  =  {1,  ...,n},  J;  =  U  Jlk  and  Jtm  nJ,  =  0  V  m,p  €  if.  When  adding  these 
constraints  to  a  MIP,  we  set  branching  priorities  such  that  yt  has  the  highest  priority,  the  yik , 
k  6  K,  have  the  next  highest  priority,  and  the  Xj  have  the  lowest  priority. 

We  apply  nested  ECB  to  the  GAP  by  adding  the  basic  ECB  constraints 

^2xot-yt  =  0VteT,  (V5) 

oeOt 

and  then  adding  only  one  level  of  nested  constraints 

Y^  Xot-ytk  =  0VteT,Vke  Kt, 

o€Otk 

where  the  Otk  are  disjoint  sets  of  variables  in  the  nested  ECB  constraints,  Otk   C  Ot  V 

\Kt\ 

k,  Kt  is  the  set  of  indices  of  the  nested  ECB  constraints,  and   u    Otk   =  Ot.   For  this 

fc=i 

application,  \Kt\  depends  on  \Ot\.  For  our  test  problems,  we  have  found  that  if  \Ot\  is 
small,  say  \Ot\  <  8,  it  makes  little  sense  to  form  any  nested  constraints,  and  the  basic  ECB 
constraint  will  suffice  for  that  particular  knapsack  constraint.  If  8  <  \Ot\  <  16,  we  add 
\Kt\  =  [\Ot\  /2J  =  2  nested  ECB  constraints,  each  of  which  will  also  have  at  least  four  xot 
variables.  If  \Ot\  >  16,  we  create  \Kt\  =  [\Ot\  /2J  =  4  nested  ECB  constraints,  each  of 
which  will  have  at  least  four  xot  variables. 

When  using  the  technique  of  nested  ECB  as  described  above,  there  is  always 
a  redundant  ECB  constraint  formed.  Thus,  we  omit  one  of  the  nested  ECB  constraints  when 
using  this  technique. 

Lemma  5.1     When  partitioning  the  variables  in  a  basic  ECB  constraint  into  \K\  disjoint 

n 

subsets  such  that  K  =  {1, ...,  n},  J,  =  U    J%k  and  Jlm  n  Jx    =  0  V  m,  p  €  K,  only  n  -  1 
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nested  ECB  constraints  need  to  be  added  to  achieve  the  branching  effect  ofn  nested  ECB 
constraints. 


Proof.  Consider  the  basic  ECB  constraint 


Yl  XJ  -Vi  =  °-  (V6) 


In  order  to  add  the  n  nested  constraints,  we  partition  the  variables  j  e  Ji  into  n  disjoint 
subsets  such  that  K  =  { 1 , . . . , 
the  n  constraints  of  the  form 


subsets  such  that  K  =  {1, ...,  n},  J2  =  U   Jlk  and  Jlm  n  J,   =  0  V  m,  p  e  K.  Now,  we  form 

fc=i 


Yl  xj =yi*- 

j€Jik 

If  we  add  the  first  n  —  1  nested  constraints,  when  yj  and  ylk  are  integer  for  ifc  =  1 ,  2, . . . ,  n  —  1 , 
the  higher  branching  priority  of  yi  ensures  that 

22  Xj  =  yi-  yj,  -  ...  -  ylr,_x.    QED 

We  have  discussed  one  example  of  adding  nested  constraints  in  the  context 
of  static  ECB.  Next,  we  discuss  how  we  use  a  semi-dynamic  procedure  to  form  nested  ECB 
constraints. 

b.  Semi-dynamic  ECB 

Semi-dynamic  ECB  uses  information  from  one  or  more  LP  solutions  to  de- 
termine the  composition  of  the  nested  ECB  constraints.  We  can  implement  this  technique 
by  simply  solving  the  LP  relaxation  of  the  IP,  order  the  fractional  variables  in  some  mean- 
ingful way  (perhaps  focusing  on  those  variables  with  x3  w  .5;  i.e.,  "furthest"  from  being 
integer),  and  apportion  the  most  important  fractional  variables  as  evenly  as  possible  among 
the  nested  ECB  constraints. 

When  we  combine  ECB  and  knapsack  constraint  generation  in  composite 
enumeration,  we  have  information  from  the  LP  solutions  in  the  constraint  generation  phase 
that  we  can  heuristically  use  to  decide  how  to  implement  ECB.  In  the  constraint  generation 
phase,  we  typically  solve  an  LP,  generate  knapsack  cuts  (if  they  exist)  for  each  knapsack 
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constraint,  solve  the  modified  LP  and  recursively  generate  cuts  and  solve  LPs  until  no  more 
knapsack  cuts  can  be  found. 

To  implement  semi-dynamic  ECB,  we  form  a  vector  f,  and  use  it  to  record  the 
number  of  LP  solutions  fj  in  which  the  variable  Xj  is  fractional  in  the  constraint  generation 
phase.  We  use  this  information  to  decide  the  composition  of  the  subsets  of  variables  for 
each  nested  ECB  constraint  and  also  use  the  information  to  decide  how  many  nested  ECB 
constraints  will  be  added  for  a  particular  basic  ECB  constraint.  Intuitively,  we  hope  that 
variables  that  are  nearly  always  integer  (fj  small)  in  the  constraint  generation  phase  will 
stay  integer  in  the  LP  solutions  during  the  branch  and  bound.  This  should  allow  our  nested 
ECB  constraints  to  focus  on  the  variables  that  are  more  likely  to  be  fractional  in  the  branch 
and  bound  (fj  large). 

Just  as  with  the  description  of  SOS  Type  1  in  Chapter  I,  we  would  like  to 
choose  subsets  of  variables  so  that  those  with  fractional  Xj  are  evenly  apportioned  among 
all  subsets.  If  there  are  \Kt\  nested  ECB  constraints  to  be  added,  then  the  variable  that 
has  been  fractionated  the  most  is  placed  in  subset  Jix ,  the  next  most  fractionated  variable 
is  placed  in  J,2,  and  so  on  until  the  first  \Kt\  variables  are  each  placed  in  separate  ECB 
constraints.  The  (\Kt\  +  l)st  variable  is  then  placed  in  subset  Jix,  the  (\Kt\  +  2)nd  in  Ji2, 
and  so  on  until  all  variables  are  placed  in  a  subset,  effectively  distributing  the  most-often 
fractionated  variables  fairly  evenly  among  the  \Kt\  nested  constraints. 

3.  Comparison  of  Dynamic  and  Static  Techniques 

After  developing  the  technique  of  ECB,  we  discovered  a  reference  in  Jornsten  and 
Varbrand  (1991)  to  a  technique  called  "generalized  branching"  developed  by  Jornsten  and 
Larsson  (1988).  (The  original  research  report  is  unavailable  at  this  time.)  They  describe 
two  different  branching  techniques  for  the  generalized  assignment  problem,  but  the  one 
that  resembles  ECB  is  of  interest  here.  Their  dynamic  technique  at  a  node  Vj  examines  the 
knapsack  constraints 

/  ]  h,otxot  <    Ht, 

o&O, 

and  checks  to  see  if  ^    xot  is  fractional  in  the  solution  to  LP(j).  If  so,  the  restrictions 

o£Ot 
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derived  at  v3  are 


^  xot  < 

oGOt 


z2  ** 

LoeOt 


or  ^  xot  > 

oGOt 


2^  ^ot 

LoeOt 


+  1. 


Thus,  LP  (ji)  at  Uj-j  is  LP  (j)  with  the  first  restriction  added,  and  LP  (j2)  at  vJ2  is  IP  (j) 
with  the  second  restriction  added.  This  means  that  for  each  truck  t,  there  is  a  constraint 
added  each  time  Yl  xot  is  fractional  and  chosen  to  derive  restrictions  at  a  particular  node. 

o<=Ot 

Static  basic  ECB  in  our  GAP  application  described  in  Section  V2  will  branch  in  exactly 

the  same  way,  except  we  have  no  need  to  modify  the  standard  variable-based  branch  and 

bound.  Because  we  have  added  a  basic  ECB  constraint  for  each  knapsack  constraint  in  the 

GAP, 

^  xot  -  Vt  =  0  V  t  €  T, 
oeOt 
and  set  the  branching  priority  higher  on  the  yt  than  for  the  xot ,  branch  and  bound  will  enforce 

the  same  constraints  explicitly  added  by  generalized  branching  by  simply  enforcing  the 

branching  priorities  specified  by  the  ECB  technique. 
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VI.         COMPUTATIONAL  RESULTS 

Knapsack  cuts  and  explicit-constraint  branching  have  been  implemented  and  tested 
on  sets  of  generalized  assignment  problems  (GAPs).  Explicit-constraint  branching  has  also 
been  tested  on  set-partitioning  and  other  problems.  We  begin  by  giving  an  overview  of 
the  implementation.  Then,  we  summarize  computational  results  from  a  set  of  84  randomly 
generated  GAPs.  (Detailed  results  of  these  problems  are  presented  in  the  Appendix.).  We 
present  detailed  results  of  eight  real-world  GAPs  (standard  and  elastic)  from  the  petroleum 
industry  and  several  binary  integer  problems,  including  some  set-partitioning  problems. 

The  composite  solution  algorithm  is  coded  in  C  and  uses  CPLEX  3.0's  callable  li- 
brary (CPLEX,  1993)  to  solve  linear  programming  relaxations  and  to  perform  branch  and 
bound  on  the  integer  program  as  modified  by  our  techniques.  If  knapsack  cuts  are  to  be 
added  to  an  IP,  an  LP  is  solved,  and  a  knapsack  cut  is  added  for  each  eligible  knapsack 
constraint  if  such  a  cut  exists.  This  procedure  is  iterative,  so  if  any  cut  is  added  in  the 
first  iteration,  a  new  LP  is  solved  in  a  second  iteration,  cuts  are  again  derived  from  eligi- 
ble constraints,  if  possible,  and  so  on.  Cuts  added  in  previous  iterations  are  candidates  for 
cut  generation  as  well  since  they  are  also  knapsack  constraints.  This  iterative  process  ter- 
minates when  no  more  cuts  can  be  found,  or  after  20  iterations  of  adding  knapsack  cuts, 
whichever  occurs  first.  Then,  if  ECB  will  be  used,  ECB  constraints  and  variables  are  added 
and  branching  priorities  are  specified  for  the  general  integer  branching  variables.  After 
all  knapsack  and  ECB  constraints  are  added,  the  modified  IP  is  then  solved  by  CPLEX 's 
branch-and-bound  solver.  All  CPU  times  reported  here  are  from  an  IBM  RS-6000  Model 
590  with  512  megabytes  of  random  access  memory.  We  allow  a  maximum  of  1000  CPU 
seconds  with  a  relative  optimality  criterion  of  0.5%  for  all  GAPs.  Optimality  criteria  for 
other  problems  are  specified  elsewhere. 

A.         GENERALIZED  ASSIGNMENT  PROBLEM 

The  GAP  is  difficult;  real-world  problems  with  as  few  as  200  variables  cannot  be 
solved  with  standard  branch  and  bound.  We  use  two  sets  of  GAPs  to  test  knapsack  cuts  and 
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basic  ECB.  The  first  set  consists  of  84  randomly  generated  problems  taken  from  the  liter- 
ature (Osman,  1994,  Beasley  and  Chu,  1995,  Cattrysse  et  al.,  1994,  Beasley,  1997).  These 
problems  allow  each  order  to  be  delivered  by  each  truck.  The  second  set  of  eight  real-world 
problems  (Brown,  1995)  has  many  orders  that  can  only  be  delivered  by  specific  trucks;  this 
apparently  makes  these  problems  more  difficult  to  solve  than  randomly  generated  GAPs  of 
comparable  size. 

The  basic  formulation  of  the  GAP  (in  terms  of  delivering  orders  on  trucks)  is 

minimize      E  E  cotxot 

oGOtGT 

subject  to:  Y,  xot    =    1  Vo  (ORDERS) 

E  hotxot    <    Ht\ft  (TRUCKHOURS) 

oGOt 

xot    €    {0, 1}  Vo  eOt,te  T0. 

(A  complete  description  of  the  GAP  with  all  data,  indices,  and  variables  defined  appears  in 
Chapter  II.)  To  implement  explicit-constraint  branching,  the  GAP  is  modified  to 

minimize      E  E  cotxot 

oGOtGT 

subject  to:  E  xot  =    1  Vo  (ORDERS) 

tGT 

E  h°otXot  <    HtVt  (TRUCKHOURS) 

o£Ot 

E  xot    -yt   =   ovt 

oGOt 

xot  €     {0,  1}  Vo  6  Ot,  t  £  T0 

yt     e     {0,l,...,|Ot|}  Vt. 

B.         RESULTS  FOR  RANDOMLY  GENERATED  GAPS 

We  summarize  the  problem  size  and  results  for  the  84  randomly  generated  GAPs  in 
Tables  2,  3  and  4;  detailed  results  appear  in  the  Appendix.  These  problems  are  solved  with 
a  maximizing  objective  function.  The  notation  used  in  the  tables  of  results  is: 

BandB.  Branch-and-bound  solver  only.  We  attempt  to  solve  these  problems  using  only  the 
CPLEX  branch-and-bound  solver,  branching  on  the  variable  with  maximum  infeasibility. 
(This  branching  option  was  used  throughout  all  computational  tests.) 
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#  Variables 

Trucks 

Orders 

Constraints 

Variables 

<1000 

7 

40 

47 

300 

>1000 

13 

160 

173 

2000 

Table  2.  Average  problem  size  for  randomly  generated  GAPs.  There  are  64  problems  with  under  1000  variables,  and  20 
that  have  at  least  1 000  variables. 

KS.  Knapsack  cuts  are  added  before  applying  the  CPLEX  branch  and  bound  solver  to  the 
modified  IE 

ECB.  ECB  constraints  and  variables  are  added  and  branching  priorities  specified  before 
applying  the  CPLEX  branch  and  bound  solver  to  the  modified  IP 

KS/ECB.  Knapsack  cuts  and  ECB  constraints  and  variables  are  added  and  branching  pri- 
orities specified  before  applying  the  CPLEX  branch  and  bound  solver  to  the  modified  IP 
Solved.  Percentage  of  the  problems  that  were  successfully  solved  in  under  1000  CPU  sec- 
onds. 

CPU  sees.  The  average  time  in  seconds  required  to  solve  each  problem  that  could  be  solved 
in  under  1000  CPU  seconds. 

Nodes.  The  average  number  of  nodes  in  the  branch-and-bound  tree  required  by  each  prob- 
lem that  was  solved  in  under  1000  CPU  seconds.  The  letter  "K"  indicates  thousands  of 
nodes. 


BandB 

KS 

ECB 

KS/ECB 

Solved 

40.6% 

100% 

100% 

100% 

CPU  sees 

88.2 

4.3 

6.9 

2.9 

Nodes 

33K 

451 

1022 

33 

Table  3.  Summary  of  computational  results  for  random  GAPs  with  fewer  than  1000  variables.  An  average  of  22  knapsack 
cuts  are  added  per  problem  for  each  solution  procedure  using  knapsack  cuts  (KS  and  KS/ECB).  The  average  time  and 
nodes  for  branch  and  bound  reflects  only  those  problems  that  were  solved  in  under  1000  CPU  seconds. 


As  seen  in  Table  3,  over  half  of  the  smaller  GAPs  cannot  be  solved  by  standard 
branch  and  bound  alone,  but  any  of  the  techniques  developed  in  this  dissertation  will  solve 
all  64  of  these  problems.  Table  4,  which  covers  the  large  problems,  also  demonstrates  the 
inability  of  standard  branch  and  bound  to  solve  GAPs.  More  importantly,  it  demonstrates 
that  some  of  the  larger  GAPs  cannot  be  solved  when  knapsack  cuts  or  ECB  are  applied 
individually,  but  used  together,  these  techniques  solve  all  of  the  randomly  generated  GAPs. 
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BandB 

KS 

ECB 

KS/ECB 

Solved 

30% 

80% 

90% 

100% 

CPU  sees 

352.5 

113.0 

26.5 

70.1 

Nodes 

49K 

3731 

1596 

724 

Table  4.  Averaged  results  for  random  GAPs  with  1000  variables  or  more.  An  average  of  42  knapsack  cuts  were  added 
for  each  problem  successfully  solved  with  knapsack  cuts  and  branch  and  bound,  and  an  average  of  48  knapsack  cuts  were 
added  for  each  problem  solved  with  knapsack  cuts,  ECB  and  branch  and  bound.  "CPU  sees"  and  "Nodes"  reflect  average 
data  for  those  problems  solved  in  under  1000  CPU  seconds. 


c. 


RESULTS  FOR  REAL-WORLD  GAPS 


Here  we  test  ECB  and  knapsack  cuts  on  a  set  of  eight  real-world  GAPS  from  the 
petroleum  industry.  Table  5  lists  the  basic  statistics  for  these  problems. 


Model  Name 

Trucks 

Orders 

Constraints 

Variables 

LONGD 

8 

22 

30 

46 

LONGN 

6 

21 

27 

37 

BOSTD 

17 

56 

73 

330 

BOSTN 

15 

50 

65 

266 

DLWRD 

19 

70 

89 

469 

DLWRN 

11 

48 

59 

200 

LOSAD 

34 

151 

185 

1835 

LOSAN 

35 

147 

182 

1790 

Table  5.  Problem  statistics  for  real-world  GAPs. 

Table  6  lists  solution  times  and  the  number  of  branch-and-bound  nodes  for  all  solu- 
tion techniques  applied  to  these  GAPS.  However,  four  of  the  problems  are  infeasible  (de- 
noted "INF"  in  the  "Time"  column)  because  not  all  orders  can  be  delivered  in  the  time 
allotted  to  the  trucks.  These  problems  must  be  "elasticized"  in  order  to  obtain  feasibility. 
We  address  solving  the  elastic  version  of  these  GAPs  later  in  this  chapter. 

Ignoring  the  infeasible  problems,  Table  6  shows  that  knapsack  cuts  solve  only  one 
real-world  problem  when  used  alone.  This  stands  in  sharp  contrast  with  the  randomly  gener- 
ated GAPs.  ECB  solves  all  problems  with  the  exception  of  DLWRD.  As  with  the  randomly 
generated  GAPs,  all  (feasible)  problems  are  solved  when  ECB  and  knapsack  cuts  are  com- 
bined. 
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Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

LONGD 

INF 

N/A 

INF 

N/A 

N/A 

INF 

N/A 

INF 

N/A 

LONGN 

INF 

N/A 

INF 

N/A 

N/A 

INF 

N/A 

INF 

N/A 

BOSTD 

(1000) 

(151K) 

(1000) 

(138K) 

41 

11.10 

2234 

31.62 

4439 

BOSTN 

(1000) 

(158K) 

(1000) 

(133K) 

44 

11.47 

2920 

3.89 

255 

DLWRD 

(1000) 

(119K) 

(1000) 

(111K) 

57 

(1000) 

(119K) 

19.22 

2187 

DLWRN 

(1000) 

(146K) 

5.82 

1050 

40 

1.66 

60 

3.28 

109 

LOSAD 

INF 

N/A 

INF 

N/A 

N/A 

INF 

N/A 

INF 

N/A 

LOSAN 

INF 

N/A 

INF 

N/A 

N/A 

INF 

N/A 

INF 

N/A 

Table  6.  GAP  solution  results.  Time  is  in  CPU  seconds.  Problems  with  CPU  time  "(1000)"  could  not  be  solved  in  1000 
CPU  seconds.  Nodes  are  the  number  of  nodes  in  the  branch  and  bound  enumeration  tree  ("K"  indicates  thousands).  The 
number  of  knapsack  cuts  added  is  the  same  for  KS  and  KS/ECB  solutions,  so  the  information  is  only  recorded  once. 
Problems  with  "INF"  in  the  "Time"  column  are  infeasible  in  their  present  form,  and  require  elastic  constraints  to  insure 
feasiblity. 

D.         RESULTS  FOR  REAL-WORLD,  ELASTIC  GAPS 

Here  we  investigate  computation  involving  elastic  GAPs.  In  particular,  we  modify 
the  eight  real-world  GAPs  by  changing  the  knapsack  constraints  to  allow  penalized  viola- 
tion. This  can  be  thought  of  as  allowing  the  trucks  to  operate  in  an  overtime  status  with 
the  penalty  p£+  being  the  cost  of  the  overtime  for  truck  t.  The  four  real- world  problems 
that  were  infeasible  can  be  solved  with  the  addition  of  these  elastic  variables.  The  elastic 
formulation  of  the  GAP  with  ECB  constraints  added  is: 
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/  .,    /  v  Cotxot 

+ 

£ 

?t4 

o£OteT 

teT 

subject  to: 

zZ  xot 

t£T0 

/  j   hotx0t 

o&Ot 

£    xot 

oeOt 

XOt 

-4 

-yt 

< 

l 
Ht 

0 
{0, 

1} 

Vo 

v< 
vt 

Vo 

e 
e 

€ 
€ 

0 
T 
T 
0, 

4 

e 

{o, 

1,.. 

,Hl 

'} 

Vi 

€ 

T 

yt 

e 

{0, 

1,.. 

,\Ot 

s|} 

vt. 

Vt 

€ 

T 

Table  7  shows  solution  times  and  the  number  of  branch  and  bound  nodes  when  each 
technique  is  applied  to  the  elasticized  GAP  Interestingly,  the  table  shows  that  the  problems 
that  were  feasible  and  solved  without  the  benefit  of  elastic  constraints  (compare  with  Table 
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Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

LONGD 

1.69 

259 

2.19 

6 

5 

1.78 

4 

2.20 

12 

LONGN 

1.53 

82 

2.11 

95 

4 

1.48 

12 

2.11 

4 

BOSTD 

(1000) 

(170K) 

(1000) 

(129K) 

46 

2.50 

159 

3.52 

63 

BOSTN 

(1000) 

(183K) 

(1000) 

(132K) 

35 

1.75 

57 

3.00 

50 

DLWRD 

(1000) 

(113K) 

(1000) 

(102K) 

60 

(1000) 

(137K) 

8.61 

492 

DLWRN 

28.92 

10441 

7.99 

1393 

34 

1.75 

89 

3.10 

65 

LOSAD 

(1000) 

(79K) 

(1000) 

(49K) 

117 

(1000) 

(35K) 

199.03 

3725 

LOSAN 

(1000) 

(73K) 

(1000) 

(34K) 

181 

(1000) 

(36K) 

815.94 

13627 

Table  7.  Elastic  GAP  solution  results.  Time  is  in  CPU  seconds.  Nodes  are  the  number  of  nodes  in  the  branch  and  bound 
enumeration  tree.  The  number  of  knapsack  cuts  added  is  the  same  for  KS  and  KS/ECB  solutions,  so  the  information  is 
only  recorded  once. 

6)  were  all  solved  more  quickly  and  with  fewer  nodes  after  being  elasticized.  More  impor- 
tantly, problems  that  were  infeasible  are  now  solved.  This  table,  like  Table  4,  reflects  our 
general  experience:  The  combination  of  ECB  and  knapsack  cuts  solves  more  problems  than 
either  technique  applied  in  isolation. 


E. 


GAP  RESULTS  USING  NESTED  ECB 


1.  Nested  ECB  Without  Knapsack  Cuts 

We  first  test  nested  ECB  on  problems  that  cannot  be  solved  by  basic  ECB,  or  prob- 
lems that  need  more  than  10000  branch  and  bound  nodes  to  solve  using  basic  ECB.  "Nest 
ra"  refers  to  the  addition  of  n  nested  ECB  constraints,  one  of  which  is  implicit.  "SD"  refers 
to  semi-dynamic  nesting  which  apportions  variables  to  nested  constraints  using  LP  solution 
information.  In  this  case,  the  apportionment  is  accomplished  by  solving  one  LP  and  apply- 
ing the  distance  metric  described  in  Chapter  V  to  LP  solution  values.  "Static"  implies  that 
nesting  was  carried  out  by  arbitrarily  splitting  the  variables  into  the  appropriate  number  of 
disjoint  subsets,  all  of  roughly  the  same  size.  All  problems  with  "GAP"  in  the  model  name 
are  from  the  set  of  randomly  generated  GAPs. 

The  results,  shown  in  Table  8,  are  varied.  GAPllc  is  solved  best  by  nesting  four 
semi-dynamic  constraints.  GAP1  le  solves  more  quickly  using  two  static  nested  constraints. 
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Model 
Name 

Var 

Static  Nest  2 

Static  Nest  4 

SD  Nest  2 

SD  Nest  4 

Time 

Nodes 

Time 

Nodes 

Time 

Nodes 

Time 

Nodes 

GAP  lie 

500 

98.63 

23824 

6.22 

1093 

28.10 

7397 

5.29 

1015 

GAP  lie 

500 

39.84 

9601 

233.62 

53070 

123.44 

28546 

75.85 

16942 

GAPC3* 

1000 

(1000) 

(136K) 

253.59 

30443 

(1000) 

(133K) 

(1000) 

(132K) 

GAPA5* 

2000 

(1000) 

(87K) 

(1000) 

(92K) 

(1000) 

(84K) 

(1000) 

(98K) 

GAPC5 

2000 

(1000) 

(81K) 

(1000) 

(92K) 

(1000) 

(78K) 

(1000) 

(87K) 

DLWRD* 

469 

(1000) 

(120K) 

(1000) 

(118K) 

(1000) 

(118K) 

(1000) 

(111K) 

Table  8.  Nested  ECB  without  knapsack  cuts.  Time  is  in  CPU  seconds.  Nodes  are  the  number  of  nodes  in  the  branch 
and  bound  enumeration  tree.  "Var"  indicates  the  number  of  variables  in  the  problem.  An  asterisk  (*)  indicates  that  the 
problem  could  not  be  solved  by  basic  ECB. 

More  nesting  is  not  always  better  as  GAP1  le  demonstrates.  GAPA5  and  DLWRD  could  not 
be  solved  by  any  type  of  ECB  technique,  and  although  GAPC3  was  solved  by  nesting  four 
constraints,  the  basic  ECB  solution  was  better.  Note  that  the  DLWRD  problem  (the  only 
real-world  problem)  has  the  smallest  number  of  variables,  yet  cannot  be  solved  by  any  of 
the  ECB  techniques. 

2.  Nested  ECB  With  Knapsack  Cuts 

We  also  test  nested  ECB  combined  with  knapsack  cuts.  We  select  five  problems  that 
require  over  1000  nodes  to  solve  using  basic  ECB  and  knapsack  cuts.  The  semi-dynamic 
apportionment  is  accomplished  by  recording  the  number  of  LP  solutions  (all  solutions  ob- 
tained during  the  cut-generation  phase)  in  which  a  particular  variable  was  fractional,  and 
apportioning  variables  to  the  nested  constraints  based  on  the  "propensity"  of  the  variable 
to  be  fractional. 


Model 
Name 

Var 

Static  Nest  2 

Static  Nest  4 

SD  Nest  2 

SD  Nest  4 

Time 

Nodes 

Time 

Nodes 

Time 

Nodes 

Time 

Nodes 

GAPC3 

1000 

17.15 

1388 

31.77 

2968 

13.50 

992 

30.19 

3374 

GAPA5 

2000 

(1000) 

(50K) 

(1000) 

(70K) 

581.79 

25980 

(1000) 

(69K) 

GAPB5 

2000 

7.14 

57 

175.18 

6388 

16.2 

392 

137.51 

5434 

BOSTD 

330 

19.18 

2536 

48.73 

5644 

29.3 

3619 

21.10 

2276 

DLWRD 

469 

150.91 

15523 

509.67 

47680 

876.44 

83274 

(1000) 

(87K) 

Table  9.  Nested  ECB  with  knapsack  cuts.  Time  is  in  CPU  seconds.  Nodes  are  the  number  of  nodes  in  the  branch  and 
bound  enumeration  tree. 
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The  results,  shown  in  Table  9,  are  again  varied.  GAPA5  and  DLWRD  do  not  benefit 
from  nesting  having  better  solution  times  with  knapsack  cuts  and  basic  ECB.  Semi-dynamic 
nesting  with  two  nested  constraints  solves  GAPC3  most  quickly,  while  semi-dynamic  ECB 
with  four  and  static  ECB  with  two  nested  constraints  both  solve  BOSTD  in  about  20  CPU 
seconds,  quicker  than  any  other  solution  technique.  GAPB5  solves  quickly  with  both  the 
static  and  semi-dynamic  techniques  using  two  nested  constraints.  In  conclusion,  we  can 
say  that  nested  ECB  may  be  useful  for  solving  certain  problems,  and  sometimes  the  static 
technique  will  be  better  and  sometimes  the  semi-dynamic  technique  will  be.  Computational 
testing  will  be  necessary  to  determine  if  nesting  is  of  value  for  a  given  set  of  problems. 

E    STRUCTURE-INDEPENDENT  RESULTS  WITH  ECB 

Here  we  test  structure-independent  ECB  on  set-partitioning  problems  and  other 
problems  (MIPs)  containing  binary  variables  to  demonstrate  that  special  structure  is  not 
required  to  use  ECB  successfully. 

1.  Set-Partitioning  Problems  and  General  MIPs 

Set-partitioning  problems  (SPPs)  are  difficult  IPs  to  solve  and  tend  to  be  much  larger 
than  GAPs.  The  basic  formulation  of  the  SPP  is 

minimize       Yl  cjxj 
subject  to:     ^Z  aijxj    —     lVz  =  l,...,m 

xj    €    {0,1}  Vj  e  J, 

where  atj  €  {0, 1}  .  We  implement  ECB  by  using  just  one  ECB  constraint  that  ensures  that 
the  sum  of  all  the  variables  in  the  problem  is  integer  before  branching  on  any  individual 
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binary  variable.  The  modified  model  is: 
minimize       ^  cjxj 
subject  to:     J2  aijxj  =    lVt  =  l,  ...,m 

E  xj    -y    =    ° 

^  e    {o,i}Vj€J 

y     €     {l,...,m}. 

A  MIP  can  contain  continuous,  general  integer  and  binary  variables.  We  also  test 
ECB  on  more  general  MIPs  (than  the  SPP)  by  adding  a  single  ECB  constraint  of  the  form 

J2  xj    -y    =    0 

y   e    {0,1,...,|J|}. 

Here,  J  is  the  index  set  for  the  binary  variables  in  a  problem  and  y  is  the  added  general 
integer  branching  variable. 

2.  ECB  Results 

To  test  structure-independent  ECB,  we  obtained  12  integer  problems  from  the  MI- 
PLIB  at  Rice  University  (Bixby,  et  al.  1997)  and  two  SPPs  (SETP1  and  PIBOO)  from  the 
meat-packing  industry  (Brown,  1997).  We  decided  to  use  MIPLIB  problems  that  branch 
and  bound  alone  could  solve  in  a  reasonable  time  to  a  reasonable  optimality  criterion.  We 
allowed  10000  CPU  seconds,  and  solved  to  an  optimality  criterion  of  0.5%.  Results  are 
shown  in  Table  10. 
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Model 
Name 

Total 
Vars 

Binary 

1  trs 

Gen  Int 
Vars 

BandB 

ECB 

Time 

Nodes 

Time 

Nodes 

SETP1T 

2564 

^564 

0 

68.4 

1608 

7.5 

37 

SETP2 

2564 

2564 

0 

23.2 

373 

8.6 

121 

PIBOO 

377 

377 

0 

.6 

39 

.6 

4 

MOD008t 

319 

319 

0 

14.1 

5639 

1.6 

405 

CAP6000r 

6000 

6000 

0 

1983.4 

4654 

120.1 

776 

MISC03 

160 

159 

0 

8.8 

945 

14.1 

1270 

L152LAVt 

1989 

1989 

0 

151.7 

3231 

156.9 

3381 

MISC06 

1808 

112 

0 

2.4 

20 

5.4 

53 

ENIGMA 

100 

100 

0 

1.5 

337 

1.6 

331 

LSEU 

89 

89 

0 

52.9 

25089 

61.3 

24721 

P0033 

33 

33 

0 

6.0 

5806 

7.6 

6081 

P0201 

201 

201 

0 

7.7 

855 

11.8 

1375 

DCMULTI 

548 

75 

0 

12.5 

1134 

30.6 

1429 

RGN 

180 

100 

0 

15.1 

5275 

15.1 

5232 

BELL3A 

133 

39 

32 

13.2 

4516 

6.8 

2317 

Table  10.  Solving  binary  integer  problems  with  structure-independent  ECB.  Time  is  in  CPU  seconds.  Nodes  are  the 
number  of  nodes  in  the  branch  and  bound  enumeration  tree.  "  Var"  indicates  the  number  of  variables  in  the  problem.  SETP2 
is  a  modification  of  SETP1  with  adjusted  penalties  for  constraint-violation  variables.  For  all  those  problems  marked  with 
"f,"  the  CPLEX  maximum-infeasibility  branching  strategy  was  used;  that  strategy  was  better  than  the  default.  Otherwise, 
the  CPLEX  default  option  was  used  which  allows  CPLEX  to  determine  the  branching  strategy. 

ECB  helped  significantly  with  SETP1,  SETP2,  PIBOO,  MOD008,  CAP6000  and 
BELL3A.  L152LAV,  ENIGMA,  LSEU,  P0033  and  RGN  solved  in  about  the  same  time  and 
number  of  nodes  by  both  methods.  Branch  and  bound  was  the  better  solution  option  for  the 
other  four  problems. 
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Vn.         SUMMARY  AND  RECOMMENDATIONS 

This  dissertation  has  developed  enhanced  composite  enumeration  techniques  for 
solving  IPs  and  MPs.  Results  demonstrate  that  previously  unsolvable  problems  can  be 
solved  with  these  new  techniques.  This  dissertation  has  specifically  examined  constraint 
generation  from  the  knapsack  polytope  and  "explicit-constraint  branching,"  a  technique 
that  applies  constraint  branching  to  IPs  and  MIPs  that  do  not  have  the  special  problem 
structure  required  by  "implicit-constraint  branching." 

A.         CONTRIBUTIONS 

1.  Knapsack  Cuts 

In  Chapter  III,  we  developed  knapsack  cut-finding  procedures  for  minimal  cover 
cuts,  and  converted  existing  cut-strengthening  theory  into  practical  procedures  that  lift  and 
tighten  violated  minimal  cover  valid  inequalities  to  violated  knapsack  facets  in  polynomial 
time.  We  defined  a  new  class  of  knapsack  cuts  called  "non-minimal  cover  cuts,"  cuts  that 
do  not  contain  a  violated  minimal  cover  cut,  developed  a  dynamic  programming  procedure 
to  find  them,  and  developed  a  new  method,  "deficit  lifting,"  to  lift  them.  Deficit  lifting 
enables  all  non-minimal  cover  cuts  to  be  lifted  and  tightened  to  violated  facets  as  well. 

The  minimal  cover  cut-finding  procedure  finds  a  maximally  violated  minimal  cover 
cut,  if  one  exists,  in  pseudo-polynomial  time  using  dynamic  programming.  All  violated 
minimal  cover  inequalities  are  lifted  to  strong  cover  cuts  by  a  new  procedure  called  "interior 
lifting."  The  procedure  that  tightens  strong  cover  cuts  to  violated  facets  improves  upon  the 
polynomial-time  facet-finding  algorithm  of  Zemel  (1989). 

Extensions  to  knapsack  cuts  were  developed  for  elastic  knapsack  constraints  and 
non-standard  knapsack  constraints  (those  with  greater- than-or-equal-to  and  equality  senses). 
Elastic  knapsack  cuts  are  generated  by  an  adaptation  of  the  minimal  cover  cut-finding  prob- 
lem of  Chapter  III.  All  the  procedures  of  Chapter  HI  were  adapted  for  use  with  greater-than- 
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or-equal-to  and  equality  knapsack  constraints  to  allow  the  generation  of  facets  or  at  least 
strong  cuts  for  these  types  of  constraints. 

2.  Explicit-Constraint  Branching 

The  method  of  "explicit-constraint  branching"  was  developed  in  Chapter  V.  This 
technique  applies  constraint  branching  to  MIPs  lacking  the  special  structure  required  by 
standard  "implicit-constraint  branching"  techniques.  Explicit-constraint  branching  alone 
solves  some  MIPs  that  branch-and-bound  cannot,  and  nesting  the  ECB  constraints  often 
solves  more  difficult  problems.  When  combined  with  knapsack  cuts,  the  synergistic  effect 
of  ECB  with  knapsack  cuts  solves  still  more  difficult  IPs. 

B.         RECOMMENDATIONS  FOR  FUTURE  RESEARCH 

This  dissertation  developed  the  new  technique  of  explicit-constraint  branching.  Fur- 
ther study  on  nesting  strategies  and  semi-dynamic  techniques  is  necessary.  ECB  may  prove 
to  be  effective  (or  not)  for  other  classes  of  problems,  and  there  may  be  different  adaptations 
of  ECB  that  could  also  prove  effective  for  solving  difficult  problems. 

Finding  violated  knapsack  facets  that  are  not  associated  with  any  minimal  or  non- 
minimal  cover  cut  is  an  area  that  requires  further  study.  There  could  exist  a  relatively  simple 
dynamic  programming  technique  similar  to  our  minimal  cover  cut-finding  procedure  that 
can  find  these  violated  facets. 

The  implementation  of  "branch  and  cut"  using  easily  generated,  globally  valid  knap- 
sack cuts  is  warranted.  In  particular,  globally  valid  knapsack  cuts  that  were  not  apparent 
from  the  initial  LP  relaxations  may  become  apparent  and  could  be  useful  in  solving  the  re- 
stricted problems  of  the  branch  and  bound.  This  dynamic  constraint  generation  technique 
could  prove  to  be  effective  for  solving  problems  such  as  the  generalized  assignment  prob- 
lem. 

This  dissertation  has  studied  cuts  based  on  special  structure.  We  suggest  further 
study  of  structure-independent  cutting-plane  techniques  such  as  the  Chvatal-Gomory  round- 
ing method  (Chvatal,1973).  These  cuts  have  been  shown  to  be  useful,  but  our  experience 
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has  shown  that  the  methodology  can  also  be  computationally  burdensome.  Since  many 
of  these  techniques  have  finite  (convergent)  algorithms  associated  with  them,  the  develop- 
ment of  computationally  efficient,  structure-independent  cutting  planes  should  be  explored 
further. 
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APPENDIX.         COMPUTATIONAL  RESULTS 

This  appendix  contains  detailed  results  of  the  randomly  generated  generalized  assignment 
problem.  The  composite  solution  algorithm  is  coded  in  C  and  uses  CPLEX  3.0's  callable 
library  to  solve  linear  programming  relaxations  and  to  branch  and  bound  on  the  integer 
program  as  modified  by  our  solution  algorithm.  All  CPU  times  reported  here  are  from  an 
IBM  RS-6000  Model  590  with  512  megabytes  of  random  access  memory.  We  allowed  a 
maximum  of  1000  CPU  seconds  with  optimality  criterion  of  .5%. 


A. 


STATISTICS 


The  following  table  provides  probelm  size  information  for  the  84  GAP  problems. 


Model  Name 

Trucks 

Orders 

Constraints 

Variables 

GAPla-e 

5 

15 

20 

75 

GAP2a-e 

5 

20 

25 

100 

GAP3a-e 

5 

25 

30 

125 

GAP4a-e 

5 

30 

35 

150 

GAP5a-e 

8 

24 

32 

182 

GAP6a-e 

8 

32 

40 

256 

GAP7a-e 

8 

40 

48 

320 

GAP8a-e 

8 

48 

56 

384 

GAP9a-e 

10 

30 

40 

300 

GAPlOa-e 

10 

40 

50 

400 

GAPlla-e 

10 

50 

60 

500 

GAP12a-e 

10 

60 

70 

600 

GAPA1-D1 

5 

100 

105 

500 

GAPA2-D2 

5 

200 

205 

1000 

GAPA3-D3 

10 

100 

110 

1000 

GAPA4-D4 

10 

200 

210 

2000 

GAPA5-D5 

20 

100 

120 

2000 

GAPA6-D6 

20 

200 

220 

4000 

Table  1 1 .  GAP  problem  size.  The  first  60  GAP  problems  have  been  used  by  I.  H.  Osman,  "Heuristics  for  the  Generalised 
Assignment  Problem:  Simulated  Annealing  and  Tabu  Search  Approaches,"  OR  Spektrum,  Volume  17,  211-225,  (1995), 
and  D.  Cattrysse,  M.  Salomon  and  L.  N.  Van  Wassenhove,  UA  set  partitioning  heuristic  for  the  generalized  assignmnet 
problem,"  European  Journal  of  Operational  Research,  Volume  72,  167-174,  (1994).  The  final  24  problems  (GAPA1-D6) 
were  used  by  P  C.  Chu  and  J.  E.  Beasley,  "A  genetic  algorithm  for  the  generalised  assignment  problem,"  working  paper. 
The  Management  School,  Imperial  College,  London  SW7  2AZ,  England  (1995). 
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B.         RESULTS  FOR  PROBLEMS  WITH  LESS  THAN  500  VARIABLES 

The  first  50  problems  presented  no  challenge  for  any  of  the  techniques  developed  in  the 
dissertation,  to  include  using  only  knapsack  cuts  in  conjunction  with  the  branch  and  bound. 
Note  that  branch  and  bound  alone  could  not  solve  over  half  of  the  50  problems. 


Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

GAPla 

2.19 

469 

1.98 

24 

16 

1.57 

59 

1.96 

6 

GAP  lb 

12.33 

6400 

1.97 

15 

18 

1.88 

216 

2.07 

17 

GAPlc 

2.81 

929 

1.97 

2 

17 

1.58 

62 

2.02 

3 

GAPld 

2.40 

588 

1.90 

6 

13 

1.67 

104 

1.97 

15 

GAPle 

1.73 

159 

1.97 

23 

11 

1.51 

15 

1.94 

2 

GAP2a 

40.95 

33168 

1.96 

4 

18 

1.79 

238 

2.03 

4 

GAP2b 

4.12 

2897 

2.02 

7 

19 

1.58 

82 

2.04 

7 

GAP2c 

14.05 

11483 

2.26 

320 

16 

2.40 

833 

2.08 

71 

GAP2d 

49.74 

37038 

1.86 

6 

10 

1.75 

248 

1.96 

6 

GAP2e 

51.06 

38855 

2.06 

39 

23 

1.68 

197 

2.16 

42 

GAP3a 

4.80 

3045 

2.31 

3 

27 

1.65 

158 

2.37 

3 

GAP3b 

(1000) 

(308K) 

1.98 

11 

16 

1.64 

131 

2.01 

11 

GAP3c 

56.25 

35923 

2.10 

7 

18 

1.56 

51 

2.13 

7 

GAP3d 

57.43 

40139 

2.09 

8 

19 

1.52 

33 

2.16 

8 

GAP3e 

3.18 

1741 

2.21 

6 

17 

1.54 

47 

2.27 

6 

GAP4a 

(1000) 

(282K) 

2.76 

274 

21 

2.05 

422 

2.49 

53 

GAP4b 

(1000) 

(327K) 

3.35 

651 

28 

2.81 

1031 

2.58 

112 

GAP4c 

(1000) 

(322K) 

2.32 

15 

21 

1.64 

125 

2.42 

15 

GAP4d 

2.36 

825 

2.63 

8 

27 

1.55 

56 

2.72 

8 

GAP4e 

(1000) 

(283K) 

2.10 

50 

17 

2.03 

431 

2.12 

8 

GAP5a 

39.39 

24947 

2.00 

5 

16 

1.58 

46 

2.09 

5 

GAP5b 

(1000) 

(469K) 

2.11 

7 

24 

2.18 

439 

2.14 

7 

GAP5c 

(1000) 

(325K) 

1.97 

2 

15 

2.18 

479 

2.02 

2 

GAP5d 

53.02 

37773 

1.83 

0 

12 

1.61 

61 

1.89 

0 

GAP5e 

(1000) 

(440K) 

2.01 

49 

20 

3.35 

1219 

2.07 

40 

Table  12.  Problems  with  less  than  500  variables. 
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Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

GAP6a 

314.45 

109239 

2.27 

66 

28 

2.08 

362 

2.23 

40 

GAP6b 

10.78 

61.09 

1.88 

0 

11 

1.56 

38 

1.95 

0 

GAP6c 

109.20 

56435 

2.26 

6 

25 

1.64 

73 

2.39 

6 

GAP6d 

65.98 

33337 

2.25 

9 

24 

1.73 

133 

2.29 

6 

GAP6e 

(1000) 

(444K) 

2.16 

6 

28 

2.06 

309 

2.26 

4 

GAP7a 

(1000) 

(437K) 

2.47 

85 

20 

1.61 

35 

2.34 

8 

GAP7b 

(1000) 

(348K) 

2.18 

17 

21 

2.07 

274 

2.19 

17 

GAP7c 

(1000) 

(406K) 

1.96 

5 

11 

1.60 

34 

2.01 

5 

GAP7d 

(1000) 

(428K) 

2.10 

63 

19 

1.89 

183 

2.13 

44 

GAP7e 

(1000) 

(430K) 

2.36 

18 

25 

1.70 

84 

2.44 

16 

GAP8a 

(1000) 

(478K) 

2.19 

21 

22 

1.91 

165 

2.17 

21 

GAP8b 

(1000) 

(474K) 

2.14 

68 

15 

1.81 

90 

2.15 

13 

GAP8c 

(1000) 

(295K) 

2.02 

3 

15 

1.61 

36 

2.07 

3 

GAP8d 

61.98 

27735 

2.06 

3 

13 

1.61 

20 

2.14 

3 

GAP8e 

(1000) 

(41  OK) 

2.13 

31 

21 

1.83 

102 

2.25 

26 

GAP9a 

(1000) 

(42  IK) 

2.13 

62 

21 

16.40 

6988 

2.13 

28 

GAP9b 

(1000) 

(424K) 

2.33 

85 

34 

6.30 

2426 

2.42 

102 

GAP9c 

(1000) 

(370K) 

2.07 

2 

24 

1.86 

174 

2.13 

2 

GAP9d 

(1000) 

(422K) 

2.10 

13 

27 

2.27 

366 

2.16 

11 

GAP9e 

138.70 

62376 

2.11 

7 

17 

1.72 

95 

2.19 

7 

GAP  10a 

(1000) 

(439K) 

2.41 

15 

31 

2.06 

230 

2.48 

15 

GAP  10b 

(1000) 

(462K) 

2.81 

210 

25 

2.52 

397 

2.57 

82 

GAP  10c 

(1000) 

(392K) 

2.26 

15 

25 

18.76 

6804 

2.29 

15 

GAPlOd 

(1000) 

(327K) 

2.17 

26 

24 

2.10 

214 

2.27 

21 

GAPlOe 

(1000) 

(426K) 

2.09 

9 

21 

2.54 

359 

2.18 

9 

c. 


Table  13.  Problems  with  less  than  500  variables. 

RESULTS  FOR  PROBLEMS  WITH  500  AND  600  VARIABLES 


These  problems  began  to  challenge  the  techniques  and  the  computer  memory.  In  a  few  cases 
(GAPA 1  and  GAPD 1 ),  the  time  required  to  generate  cuts  is  significant,  causing  solution  time 
to  increase.  The  large  number  of  nodes  required  by  ECB  to  solve  GAPllc  and  GAPlle 
mark  them  as  candidates  for  nested  ECB.  GAP  12c  and  GAPD1  are  the  first  two  instances 
where  the  computer  terminated  the  solution  process  prematurely.  In  both  cases,  there  was 
insufficient  memory  to  keep  the  extensive  data  required  by  the  branch-and-bound  process. 
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Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

GAPlla 

172.81 

59274 

2.84 

98 

32 

2.21 

225 

2.77 

25 

GAPllb 

(1000) 

(304K) 

2.18 

19 

19 

1.99 

124 

2.31 

30 

GAPllc 

(1000) 

(364K) 

2.71 

19 

30 

56.79 

15423 

2.70 

19 

GAPlld 

830.71 

192307 

2.86 

182 

25 

2.30 

255 

2.47 

22 

GAPlle 

(1000) 

(391K) 

73.02 

18892 

43 

61.26 

18999 

4.28 

299 

GAP  12a 

(1000) 

(304K) 

2.99 

11 

39 

3.14 

460 

3.08 

21 

GAP12b 

(1000) 

(304K) 

3.98 

349 

30 

2.57 

272 

3.06 

25 

GAP12c 

(983.62) 

(304K) 

3.20 

43 

34 

4.52 

810 

3.26 

34 

GAP  1 2d 

(1000) 

(304K) 

3.56 

36 

43 

2.91 

390 

3.56 

35 

GAP12e 

(1000) 

(304K) 

2.34 

11 

26 

1.76 

44 

2.52 

22 

GAPA1 

190.48 

64588 

19.03 

2609 

24 

1.89 

109 

10.24 

122 

GAPB1 

(1000) 

(311K) 

9.16 

519 

27 

2.50 

363 

7.81 

88 

GAPC1 

(1000) 

(326K) 

17.34 

3665 

21 

5.85 

1172 

6.65 

416 

GAPD1 

(737.51) 

(295K) 

22.73 

0 

13 

1.62 

16 

22.61 

0 

D. 


Table  14.  Problems  with  500  and  600  variables. 

RESULTS  FOR  PROBLEMS  WITH  1000  VARIABLES 


Solving  with  knapsack  cuts  and  branch  and  bound  becomes  increasingly  difficult.  ECB 
does  well  with  the  exception  of  GAPC3,  which  it  cannot  solve,  making  it  a  candidate  for 
nested  ECB.  Cut  generation  time  is  significant,  making  ECB  alone  quicker  in  many  cases, 
even  when  using  more  nodes  in  branch  and  bound.  Two  problems  (GAPD2  and  GAPD3) 
terminated  early  due  to  an  unrecoverable  failure  during  the  branch-and-bound  process. 


Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

GAPA2 

428.03 

104332 

82.19 

1806 

24 

2.12 

92 

74.54 

104 

GAPB2 

70.76 

16845 

45.38 

1342 

34 

2.82 

184 

38.31 

240 

GAPC2 

33.18 

7692 

33.64 

1373 

19 

3.27 

269 

26.14 

260 

GAPD2 

(506.52) 

(126K) 

484.44 

8 

29 

1.84 

20 

482.71 

8 

GAPA3 

(1000) 

(22  IK) 

18.79 

866 

53 

2.22 

102 

14.44 

160 

GAPB3 

(1000) 

(26  IK) 

40.84 

5297 

25 

2.21 

96 

4.28 

25 

GAPC3 

(1000) 

(25  IK) 

142.75 

15681 

56 

(1000) 

(162K) 

20.07 

1311 

GAPD3 

(805.84) 

(207K) 

19.69 

8 

39 

1.95 

43 

19.75 

8 

Table  15.  Problems  with  1000  variables. 
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E. 


RESULTS  FOR  PROBLEMS  WITH  2000  VARIABLES 


Solving  with  knapsack  cuts  and  branch  and  bound  becomes  still  more  difficult,  and  GAPB5 
cannot  be  solved  with  knapsack  cuts  and  branch  and  bound.  ECB  does  well  with  the  excep- 
tion of  GAPA5,  which  ECB  cannot  solve,  and  GAPC5,  which  requires  over  20,000  nodes. 
Both  are  candidates  for  nested  ECB.  Again,  cut  generation  time  is  significant.  Two  more 
problems  (GAPC4  and  GAPD5)  terminated  early  due  to  an  unrecoverable  failure  during  the 
branch-and-bound  process. 


Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

GAPA4 

40.07 

5388 

35.51 

527 

42 

5.08 

320 

33.10 

202 

GAPB4 

(1000) 

(145K) 

48.99 

2990 

25 

3.35 

147 

11.77 

127 

GAPC4 

(977.59) 

(133K) 

42.96 

1760 

43 

3.91 

224 

24.76 

37 

GAPD4 

661.91 

94401 

140.75 

223 

32 

2.46 

49 

139.86 

36 

GAPA5 

(1000) 

(147K) 

389.71 

17879 

90 

(1000) 

(89K) 

293.70 

9621 

GAPB5 

(1000) 

(144K) 

(1000) 

(57K) 

57 

36.52 

1913 

44.13 

1337 

GAPC5 

(1000) 

(146K) 

229.26 

9787 

75 

277.36 

22677 

8.62 

178 

GAPD5 

(949.12) 

(139K) 

6.46 

30 

43 

2.82 

95 

6.40 

15 

Table  16.  Problems  with  2000  variables. 


RESULTS  FOR  PROBLEMS  WITH  4000  VARIABLES 


Solving  with  knapsack  cuts  and  branch  and  bound  nearly  impossible.  GAPA6,  GAPB6,  and 
GAPC6  cannot  be  solved  in  1 000  CPU  seconds  with  knapsack  cuts.  ECB  does  exceptionally 
well.  Knapsack  cuts  and  ECB  combined  take  fewer  nodes  than  ECB  alone  in  every  case, 
but  more  CPU  time  as  cut  generation  time  increases. 


Model 
Name 

BandB 

KS 

ECB 

KS/ECB 

Time 

Nodes 

Time 

Nodes 

Cuts 

Time 

Nodes 

Time 

Nodes 

GAPA6 

(1000) 

(76K) 

(1000) 

(56K) 

64 

9.03 

454 

33.52 

387 

GAPB6 

880.84 

66861 

(1000) 

(52K) 

84 

29.22 

694 

39.21 

152 

GAPC6 

(1000) 

(76K) 

(1000) 

(46K) 

69 

87.28 

1244 

39.09 

199 

GAPD6 

(1000) 

(75K) 

47.17 

125 

62 

4.21 

109 

47.53 

66 

Table  17.  Problems  with  4000  variables. 


These  problems  are  so  large  that  the  number  of  branch-and-bound  nodes  that  can  be  transited 
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in  1000  CPU  seconds  is  much  fewer  than  the  mid-sized  problems,  which  possibly  explains 
why  there  were  no  premature  terminations  of  the  solution  process  for  these  problems. 
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